Oct 25 16:20:27 user nova-compute[74048]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74048) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 16:20:27 user nova-compute[74048]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74048) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 16:20:27 user nova-compute[74048]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74048) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 16:20:27 user nova-compute[74048]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 25 16:20:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:20:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:20:28 user nova-compute[74048]: INFO nova.virt.driver [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 25 16:20:28 user nova-compute[74048]: INFO nova.compute.provider_config [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Acquiring lock "singleton_lock" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Acquired lock "singleton_lock" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Releasing lock "singleton_lock" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Full set of CONF: {{(pid=74048) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ******************************************************************************** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Configuration options gathered from: {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ================================================================================ {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] allow_resize_to_same_host      = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] arq_binding_timeout            = 300 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] backdoor_port                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] backdoor_socket                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] block_device_allocate_retries  = 300 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] block_device_allocate_retries_interval = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cert                           = self.pem {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute_monitors               = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] config_dir                     = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] config_drive_format            = iso9660 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] config_source                  = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] console_host                   = user {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] control_exchange               = nova {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cpu_allocation_ratio           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] daemon                         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] debug                          = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] default_access_ip_network_name = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] default_availability_zone      = nova {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] default_ephemeral_format       = ext4 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] default_green_pool_size        = 1000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] default_schedule_zone          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] disk_allocation_ratio          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] enable_new_services            = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] enabled_apis                   = ['osapi_compute'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] enabled_ssl_apis               = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] flat_injected                  = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] force_config_drive             = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] force_raw_images               = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] graceful_shutdown_timeout      = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] heal_instance_info_cache_interval = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] host                           = user {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_build_timeout         = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_delete_interval       = 300 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_format                = [instance: %(uuid)s]  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_name_template         = instance-%08x {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_usage_audit           = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_usage_audit_period    = month {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] internal_service_availability_zone = internal {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] key                            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] live_migration_retry_count     = 30 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_config_append              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_dir                        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_file                       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_options                    = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_rotate_interval            = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_rotate_interval_type       = days {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] log_rotation_type              = none {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] long_rpc_timeout               = 1800 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] max_concurrent_builds          = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] max_concurrent_live_migrations = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] max_concurrent_snapshots       = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] max_local_block_devices        = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] max_logfile_count              = 30 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] max_logfile_size_mb            = 200 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] maximum_instance_delete_attempts = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metadata_listen                = 0.0.0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metadata_listen_port           = 8775 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metadata_workers               = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] migrate_max_retries            = -1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] mkisofs_cmd                    = genisoimage {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] my_ip                          = 10.0.0.210 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] network_allocate_retries       = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] osapi_compute_listen_port      = 8774 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] osapi_compute_unique_server_name_scope =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] osapi_compute_workers          = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] password_length                = 12 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] periodic_enable                = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] periodic_fuzzy_delay           = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] pointer_model                  = ps2mouse {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] preallocate_images             = none {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] publish_errors                 = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] pybasedir                      = /opt/stack/nova {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ram_allocation_ratio           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rate_limit_burst               = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rate_limit_except_level        = CRITICAL {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rate_limit_interval            = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reboot_timeout                 = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reclaim_instance_interval      = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] record                         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reimage_timeout_per_gb         = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] report_interval                = 120 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rescue_timeout                 = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reserved_host_cpus             = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reserved_host_disk_mb          = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reserved_host_memory_mb        = 512 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] reserved_huge_pages            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] resize_confirm_window          = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] resize_fs_using_block_device   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] resume_guests_state_on_host_boot = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rpc_response_timeout           = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] run_external_periodic_tasks    = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] running_deleted_instance_action = reap {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] running_deleted_instance_poll_interval = 1800 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] running_deleted_instance_timeout = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler_instance_sync_interval = 120 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_down_time              = 720 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] servicegroup_driver            = db {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] shelved_offload_time           = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] shelved_poll_interval          = 3600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] shutdown_timeout               = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] source_is_ipv6                 = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ssl_only                       = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] state_path                     = /opt/stack/data/nova {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] sync_power_state_interval      = 600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] sync_power_state_pool_size     = 1000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] syslog_log_facility            = LOG_USER {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] tempdir                        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] timeout_nbd                    = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] transport_url                  = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] update_resources_interval      = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_cow_images                 = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_eventlog                   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_journal                    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_json                       = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_rootwrap_daemon            = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_stderr                     = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] use_syslog                     = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vcpu_pin_set                   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plugging_is_fatal          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plugging_timeout           = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] virt_mkfs                      = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] volume_usage_poll_interval     = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] watch_log_file                 = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] web                            = /usr/share/spice-html5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_concurrency.disable_process_locking = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.auth_strategy              = keystone {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.compute_link_prefix        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.dhcp_domain                = novalocal {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.enable_instance_password   = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.glance_link_prefix         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.instance_list_per_project_cells = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.list_records_by_skipping_down_cells = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.local_metadata_per_cell    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.max_limit                  = 1000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.metadata_cache_expiration  = 15 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.neutron_default_tenant_id  = default {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.use_forwarded_for          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.use_neutron_default_nets   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_dynamic_targets = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_jsonfile_path   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.backend                  = dogpile.cache.memcached {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.backend_argument         = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.config_prefix            = cache.oslo {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.dead_timeout             = 60.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.debug_cache_backend      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.enable_retry_client      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.enable_socket_keepalive  = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.enabled                  = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.expiration_time          = 600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.hashclient_retry_attempts = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_dead_retry      = 300 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_password        =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_pool_maxsize    = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_sasl_enabled    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.memcache_username        =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.proxies                  = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.retry_attempts           = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.retry_delay              = 0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.socket_keepalive_count   = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.socket_keepalive_idle    = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.socket_keepalive_interval = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.tls_allowed_ciphers      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.tls_cafile               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.tls_certfile             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.tls_enabled              = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cache.tls_keyfile              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.auth_section            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.auth_type               = password {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.cafile                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.certfile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.collect_timing          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.cross_az_attach         = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.debug                   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.endpoint_template       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.http_retries            = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.insecure                = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.keyfile                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.os_region_name          = RegionOne {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.split_loggers           = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cinder.timeout                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.cpu_dedicated_set      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.cpu_shared_set         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.image_type_exclude_list = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.max_concurrent_disk_ops = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.max_disk_devices_to_attach = -1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.resource_provider_association_refresh = 300 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.shutdown_retry_interval = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] conductor.workers              = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] console.allowed_origins        = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] console.ssl_ciphers            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] console.ssl_minimum_version    = default {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] consoleauth.token_ttl          = 600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.cafile                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.certfile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.collect_timing          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.connect_retries         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.connect_retry_delay     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.endpoint_override       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.insecure                = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.keyfile                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.max_version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.min_version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.region_name             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.service_name            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.service_type            = accelerator {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.split_loggers           = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.status_code_retries     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.timeout                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] cyborg.version                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.backend               = sqlalchemy {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.connection            = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.connection_debug      = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.connection_parameters =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.connection_recycle_time = 3600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.connection_trace      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.db_inc_retry_interval = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.db_max_retries        = 20 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.db_max_retry_interval = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.db_retry_interval     = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.max_overflow          = 50 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.max_pool_size         = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.max_retries           = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.mysql_wsrep_sync_wait = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.pool_timeout          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.retry_interval        = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.slave_connection      = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] database.sqlite_synchronous    = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.backend           = sqlalchemy {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.connection        = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.connection_debug  = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.connection_parameters =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.connection_recycle_time = 3600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.connection_trace  = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.db_inc_retry_interval = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.db_max_retries    = 20 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.db_max_retry_interval = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.db_retry_interval = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.max_overflow      = 50 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.max_pool_size     = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.max_retries       = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.pool_timeout      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.retry_interval    = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.slave_connection  = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] api_database.sqlite_synchronous = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] devices.enabled_mdev_types     = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ephemeral_storage_encryption.enabled = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.api_servers             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.cafile                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.certfile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.collect_timing          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.connect_retries         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.connect_retry_delay     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.debug                   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.default_trusted_certificate_ids = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.enable_certificate_validation = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.enable_rbd_download     = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.endpoint_override       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.insecure                = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.keyfile                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.max_version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.min_version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.num_retries             = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.rbd_ceph_conf           =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.rbd_connect_timeout     = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.rbd_pool                =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.rbd_user                =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.region_name             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.service_name            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.service_type            = image {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.split_loggers           = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.status_code_retries     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.timeout                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.verify_glance_signatures = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] glance.version                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] guestfs.debug                  = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.config_drive_cdrom      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.config_drive_inject_password = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.enable_instance_metrics_collection = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.enable_remotefx         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.instances_path_share    =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.iscsi_initiator_list    = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.limit_cpu_features      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.power_state_check_timeframe = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.use_multipath_io        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.volume_attach_retry_count = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.vswitch_name            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] mks.enabled                    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] image_cache.manager_interval   = 2400 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] image_cache.precache_concurrency = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] image_cache.remove_unused_base_images = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] image_cache.subdirectory_name  = _base {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.api_max_retries         = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.api_retry_interval      = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.auth_section            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.auth_type               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.cafile                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.certfile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.collect_timing          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.conductor_group         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.connect_retries         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.connect_retry_delay     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.endpoint_override       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.insecure                = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.keyfile                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.max_version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.min_version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.peer_list               = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.region_name             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.serial_console_state_timeout = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.service_name            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.service_type            = baremetal {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.split_loggers           = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.status_code_retries     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.timeout                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ironic.version                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] key_manager.fixed_key          = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.barbican_api_version  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.barbican_endpoint     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.barbican_endpoint_type = public {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.barbican_region_name  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.cafile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.certfile              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.collect_timing        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.insecure              = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.keyfile               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.number_of_retries     = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.retry_delay           = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.send_service_user_token = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.split_loggers         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.timeout               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.verify_ssl            = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican.verify_ssl_path       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.auth_section = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.auth_type = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.cafile   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.certfile = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.collect_timing = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.insecure = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.keyfile  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.split_loggers = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] barbican_service_user.timeout  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.approle_role_id          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.approle_secret_id        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.cafile                   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.certfile                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.collect_timing           = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.insecure                 = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.keyfile                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.kv_mountpoint            = secret {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.kv_path                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.kv_version               = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.namespace                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.root_token_id            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.split_loggers            = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.ssl_ca_crt_file          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.timeout                  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.use_ssl                  = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.auth_section          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.auth_type             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.cafile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.certfile              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.collect_timing        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.connect_retries       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.connect_retry_delay   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.endpoint_override     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.insecure              = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.keyfile               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.max_version           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.min_version           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.region_name           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.service_name          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.service_type          = identity {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.split_loggers         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.status_code_retries   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.timeout               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] keystone.version               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.connection_uri         =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_mode               = custom {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: WARNING oslo_config.cfg [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_power_governor_high = performance {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_power_governor_low = powersave {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_power_management   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.device_detach_attempts = 8 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.device_detach_timeout  = 20 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.disk_cachemodes        = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.disk_prefix            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.enabled_perf_events    = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.file_backed_memory     = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.gid_maps               = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.hw_disk_discard        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.hw_machine_type        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_rbd_glance_store_name =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_rbd_pool        = rbd {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_type            = default {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.images_volume_group    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.inject_key             = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.inject_partition       = -2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.inject_password        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.iscsi_iface            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.iser_use_multipath     = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_bandwidth = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_downtime = 500 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_inbound_addr = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_permit_post_copy = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_scheme  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_timeout_action = abort {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_tunnelled = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: WARNING oslo_config.cfg [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 25 16:20:28 user nova-compute[74048]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 25 16:20:28 user nova-compute[74048]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 25 16:20:28 user nova-compute[74048]: and ``live_migration_inbound_addr`` respectively.
Oct 25 16:20:28 user nova-compute[74048]: ).  Its value may be silently ignored in the future.
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.live_migration_with_native_tls = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.max_queues             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.nfs_mount_options      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.num_memory_encrypted_guests = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.num_pcie_ports         = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.pmem_namespaces        = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.quobyte_client_cfg     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rbd_secret_uuid        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rbd_user               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.remote_filesystem_transport = ssh {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rescue_image_id        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rescue_kernel_id       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rescue_ramdisk_id      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.rx_queue_size          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.smbfs_mount_options    =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.snapshot_compression   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.snapshot_image_format  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.sparse_logical_volumes = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.swtpm_enabled          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.swtpm_group            = tss {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.swtpm_user             = tss {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.sysinfo_serial         = unique {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.tb_cache_size          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.tx_queue_size          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.uid_maps               = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.use_virtio_for_bridges = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.virt_type              = kvm {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.volume_clear           = zero {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.volume_clear_size      = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.volume_use_multipath   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_cache_path   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.vzstorage_mount_user   = stack {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.auth_section           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.auth_type              = password {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.cafile                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.certfile               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.collect_timing         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.connect_retries        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.connect_retry_delay    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.default_floating_pool  = public {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.endpoint_override      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.extension_sync_interval = 600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.http_retries           = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.insecure               = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.keyfile                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.max_version            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.min_version            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.ovs_bridge             = br-int {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.physnets               = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.region_name            = RegionOne {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.service_metadata_proxy = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.service_name           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.service_type           = network {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.split_loggers          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.status_code_retries    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.timeout                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] neutron.version                = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] notifications.bdms_in_notifications = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] notifications.default_level    = INFO {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] notifications.notification_format = unversioned {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] notifications.notify_on_state_change = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] pci.alias                      = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] pci.device_spec                = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] pci.report_in_placement        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.auth_section         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.auth_type            = password {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.cafile               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.certfile             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.collect_timing       = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.connect_retries      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.connect_retry_delay  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.default_domain_id    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.default_domain_name  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.domain_id            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.domain_name          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.endpoint_override    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.insecure             = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.keyfile              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.max_version          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.min_version          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.password             = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.project_domain_id    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.project_domain_name  = Default {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.project_id           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.project_name         = service {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.region_name          = RegionOne {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.service_name         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.service_type         = placement {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.split_loggers        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.status_code_retries  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.system_scope         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.timeout              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.trust_id             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.user_domain_id       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.user_domain_name     = Default {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.user_id              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.username             = placement {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] placement.version              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.cores                    = 20 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.count_usage_from_placement = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.injected_file_content_bytes = 10240 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.injected_file_path_length = 255 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.injected_files           = 5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.instances                = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.key_pairs                = 100 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.metadata_items           = 128 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.ram                      = 51200 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.recheck_quota            = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.server_group_members     = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] quota.server_groups            = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rdp.enabled                    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.image_metadata_prefilter = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.max_attempts         = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.max_placement_results = 1000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.query_placement_for_image_type_support = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] scheduler.workers              = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.host_subset_size = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.isolated_hosts = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.isolated_images = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.pci_in_placement = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.track_instance_changes = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metrics.required               = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metrics.weight_multiplier      = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] metrics.weight_setting         = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] serial_console.enabled         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] serial_console.port_range      = 10000:20000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] serial_console.serialproxy_port = 6083 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.auth_section      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.auth_type         = password {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.cafile            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.certfile          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.collect_timing    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.insecure          = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.keyfile           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.send_service_user_token = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.split_loggers     = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] service_user.timeout           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.agent_enabled            = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.enabled                  = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.html5proxy_port          = 6082 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.image_compression        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.jpeg_compression         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.playback_compression     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.server_listen            = 127.0.0.1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.streaming_mode           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] spice.zlib_compression         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] upgrade_levels.baseapi         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] upgrade_levels.cert            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] upgrade_levels.compute         = auto {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] upgrade_levels.conductor       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] upgrade_levels.scheduler       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.auth_section = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.auth_type = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.cafile = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.certfile = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.insecure = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.keyfile = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vendordata_dynamic_auth.timeout = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.api_retry_count         = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.ca_file                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.cache_prefix            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.cluster_name            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.connection_pool_size    = 10 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.console_delay_seconds   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.datastore_regex         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.host_ip                 = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.host_password           = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.host_port               = 443 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.host_username           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.insecure                = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.integration_bridge      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.maximum_objects         = 100 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.pbm_default_policy      = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.pbm_enabled             = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.pbm_wsdl_location       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.serial_port_proxy_uri   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.serial_port_service_uri = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.task_poll_interval      = 0.5 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.use_linked_clone        = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.vnc_keymap              = en-us {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.vnc_port                = 5900 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vmware.vnc_port_total          = 10000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.auth_schemes               = ['none'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.enabled                    = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.novncproxy_port            = 6080 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.server_listen              = 0.0.0.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.vencrypt_ca_certs          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.vencrypt_client_cert       = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vnc.vencrypt_client_key        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.disable_rootwrap   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.enable_numa_live_migration = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.libvirt_disable_apic = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.client_socket_timeout     = 900 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.default_pool_size         = 1000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.keep_alive                = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.max_header_line           = 16384 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.ssl_ca_file               = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.ssl_cert_file             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.ssl_key_file              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.tcp_keepidle              = 600 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] zvm.ca_file                    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] zvm.cloud_connector_url        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] zvm.reachable_timeout          = 300 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.enforce_new_defaults = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.enforce_scope      = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.policy_default_rule = default {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.policy_file        = policy.yaml {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.connection_string     = messaging:// {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.enabled               = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.es_doc_type           = notification {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.es_scroll_size        = 10000 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.es_scroll_time        = 2m {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.filter_error_trace    = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.hmac_keys             = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.sentinel_service_name = mymaster {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.socket_timeout        = 0.1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.trace_requests        = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler.trace_sqlalchemy      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler_jaeger.process_tags   = {} {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler_jaeger.service_name_prefix = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] profiler_otlp.service_name_prefix = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] remote_debug.host              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] remote_debug.port              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.ssl      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_notifications.retry = -1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_messaging_notifications.transport_url = **** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.auth_section        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.auth_type           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.cafile              = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.certfile            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.collect_timing      = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.connect_retries     = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.connect_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.endpoint_id         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.endpoint_override   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.insecure            = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.keyfile             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.max_version         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.min_version         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.region_name         = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.service_name        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.service_type        = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.split_loggers       = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.status_code_retries = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.status_code_retry_delay = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.timeout             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.valid_interfaces    = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_limit.version             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_reports.file_event_handler = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] oslo_reports.log_dir           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_ovs_privileged.group  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] vif_plug_ovs_privileged.user   = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.flat_interface = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.isolate_vif         = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_vif_ovs.per_port_bridge     = False {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] os_brick.lock_path             = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] privsep_osbrick.capabilities   = [21] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] privsep_osbrick.group          = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] privsep_osbrick.helper_command = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] privsep_osbrick.user           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] nova_sys_admin.group           = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] nova_sys_admin.helper_command  = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] nova_sys_admin.user            = None {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG oslo_service.service [None req-1bf88012-9828-49c1-beea-5bf06c40240b None None] ******************************************************************************** {{(pid=74048) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 25 16:20:28 user nova-compute[74048]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Connecting to libvirt: qemu:///system {{(pid=74048) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f18587c2680> {{(pid=74048) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 25 16:20:28 user nova-compute[74048]: libvirt:  error : internal error: could not initialize domain event timer
Oct 25 16:20:28 user nova-compute[74048]: WARNING nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f18587c2680> {{(pid=74048) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Starting native event thread {{(pid=74048) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Starting green dispatch thread {{(pid=74048) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Starting connection event dispatch thread {{(pid=74048) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 25 16:20:28 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Connection event '1' reason 'None'
Oct 25 16:20:28 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 16:20:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.mount [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Initialising _HostMountState generation 0 {{(pid=74048) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 25 16:20:35 user nova-compute[74048]: INFO nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host capabilities <capabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <host>
Oct 25 16:20:35 user nova-compute[74048]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 25 16:20:35 user nova-compute[74048]:     <cpu>
Oct 25 16:20:35 user nova-compute[74048]:       <arch>x86_64</arch>
Oct 25 16:20:35 user nova-compute[74048]:       <model>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <microcode version='1070'/>
Oct 25 16:20:35 user nova-compute[74048]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='osxsave'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='invtsc'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='rsba'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature name='skip-l1dfl-vmentry'/>
Oct 25 16:20:35 user nova-compute[74048]:       <pages unit='KiB' size='4'/>
Oct 25 16:20:35 user nova-compute[74048]:       <pages unit='KiB' size='2048'/>
Oct 25 16:20:35 user nova-compute[74048]:     </cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <power_management>
Oct 25 16:20:35 user nova-compute[74048]:       <suspend_mem/>
Oct 25 16:20:35 user nova-compute[74048]:       <suspend_disk/>
Oct 25 16:20:35 user nova-compute[74048]:       <suspend_hybrid/>
Oct 25 16:20:35 user nova-compute[74048]:     </power_management>
Oct 25 16:20:35 user nova-compute[74048]:     <iommu support='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <migration_features>
Oct 25 16:20:35 user nova-compute[74048]:       <live/>
Oct 25 16:20:35 user nova-compute[74048]:       <uri_transports>
Oct 25 16:20:35 user nova-compute[74048]:         <uri_transport>tcp</uri_transport>
Oct 25 16:20:35 user nova-compute[74048]:         <uri_transport>rdma</uri_transport>
Oct 25 16:20:35 user nova-compute[74048]:       </uri_transports>
Oct 25 16:20:35 user nova-compute[74048]:     </migration_features>
Oct 25 16:20:35 user nova-compute[74048]:     <topology>
Oct 25 16:20:35 user nova-compute[74048]:       <cells num='2'>
Oct 25 16:20:35 user nova-compute[74048]:         <cell id='0'>
Oct 25 16:20:35 user nova-compute[74048]:           <memory unit='KiB'>8189224</memory>
Oct 25 16:20:35 user nova-compute[74048]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 25 16:20:35 user nova-compute[74048]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 16:20:35 user nova-compute[74048]:           <distances>
Oct 25 16:20:35 user nova-compute[74048]:             <sibling id='0' value='10'/>
Oct 25 16:20:35 user nova-compute[74048]:             <sibling id='1' value='20'/>
Oct 25 16:20:35 user nova-compute[74048]:           </distances>
Oct 25 16:20:35 user nova-compute[74048]:           <cpus num='6'>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 25 16:20:35 user nova-compute[74048]:           </cpus>
Oct 25 16:20:35 user nova-compute[74048]:         </cell>
Oct 25 16:20:35 user nova-compute[74048]:         <cell id='1'>
Oct 25 16:20:35 user nova-compute[74048]:           <memory unit='KiB'>8206460</memory>
Oct 25 16:20:35 user nova-compute[74048]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 25 16:20:35 user nova-compute[74048]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 16:20:35 user nova-compute[74048]:           <distances>
Oct 25 16:20:35 user nova-compute[74048]:             <sibling id='0' value='20'/>
Oct 25 16:20:35 user nova-compute[74048]:             <sibling id='1' value='10'/>
Oct 25 16:20:35 user nova-compute[74048]:           </distances>
Oct 25 16:20:35 user nova-compute[74048]:           <cpus num='6'>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 25 16:20:35 user nova-compute[74048]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 25 16:20:35 user nova-compute[74048]:           </cpus>
Oct 25 16:20:35 user nova-compute[74048]:         </cell>
Oct 25 16:20:35 user nova-compute[74048]:       </cells>
Oct 25 16:20:35 user nova-compute[74048]:     </topology>
Oct 25 16:20:35 user nova-compute[74048]:     <cache>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 25 16:20:35 user nova-compute[74048]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 25 16:20:35 user nova-compute[74048]:     </cache>
Oct 25 16:20:35 user nova-compute[74048]:     <secmodel>
Oct 25 16:20:35 user nova-compute[74048]:       <model>apparmor</model>
Oct 25 16:20:35 user nova-compute[74048]:       <doi>0</doi>
Oct 25 16:20:35 user nova-compute[74048]:     </secmodel>
Oct 25 16:20:35 user nova-compute[74048]:     <secmodel>
Oct 25 16:20:35 user nova-compute[74048]:       <model>dac</model>
Oct 25 16:20:35 user nova-compute[74048]:       <doi>0</doi>
Oct 25 16:20:35 user nova-compute[74048]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 25 16:20:35 user nova-compute[74048]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 25 16:20:35 user nova-compute[74048]:     </secmodel>
Oct 25 16:20:35 user nova-compute[74048]:   </host>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='alpha'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>clipper</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='armv6l'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>spitz</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>nuri</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>kzm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sx1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>z2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>tosa</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>n810</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>n800</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>terrier</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>midway</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>microbit</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>verdex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>highbank</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>akita</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>connex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>collie</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='armv7l'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>spitz</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>nuri</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>kzm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sx1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>z2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>tosa</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>n810</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>n800</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>terrier</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>midway</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>microbit</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>verdex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>highbank</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>akita</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>connex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>collie</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='aarch64'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>spitz</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>nuri</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>kzm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sx1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>z2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>tosa</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>n810</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>n800</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>terrier</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>midway</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>microbit</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>verdex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>raspi3b</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>highbank</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>akita</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>connex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>collie</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <acpi default='on' toggle='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='cris'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='i686'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>isapc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>microvm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='kvm'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <pae/>
Oct 25 16:20:35 user nova-compute[74048]:       <nonpae/>
Oct 25 16:20:35 user nova-compute[74048]:       <acpi default='on' toggle='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:       <apic default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='m68k'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>an5206</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>q800</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>next-cube</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='microblaze'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='microblazeel'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='mips'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='16'>malta</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='mipsel'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='16'>malta</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='mips64'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='16'>malta</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>pica61</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>magnum</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='mips64el'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='16'>malta</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>pica61</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>magnum</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='16'>boston</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='ppc'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mac99</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>40p</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>taihu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='ppc64'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>taihu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>40p</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mac99</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='ppc64le'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>taihu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>40p</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>mac99</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='riscv32'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='8'>spike</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>opentitan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='8'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='riscv64'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='8'>spike</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>shakti_c</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='8'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='s390x'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='sh4'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>shix</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>r2d</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='sh4eb'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>shix</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>r2d</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='sparc'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>SS-5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>SS-20</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>LX</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>SS-4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>SS-10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>Voyager</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='sparc64'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sun4u</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>niagara</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>sun4v</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='x86_64'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>64</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='1'>isapc</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>microvm</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='kvm'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <acpi default='on' toggle='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:       <apic default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='xtensa'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>sim</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>kc705</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ml605</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx200</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx60</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]:   <guest>
Oct 25 16:20:35 user nova-compute[74048]:     <os_type>hvm</os_type>
Oct 25 16:20:35 user nova-compute[74048]:     <arch name='xtensaeb'>
Oct 25 16:20:35 user nova-compute[74048]:       <wordsize>32</wordsize>
Oct 25 16:20:35 user nova-compute[74048]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='4'>sim</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>kc705</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ml605</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>virt</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx200</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>lx60</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 16:20:35 user nova-compute[74048]:       <domain type='qemu'/>
Oct 25 16:20:35 user nova-compute[74048]:     </arch>
Oct 25 16:20:35 user nova-compute[74048]:     <features>
Oct 25 16:20:35 user nova-compute[74048]:       <cpuselection/>
Oct 25 16:20:35 user nova-compute[74048]:       <deviceboot/>
Oct 25 16:20:35 user nova-compute[74048]:       <disksnapshot default='on' toggle='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     </features>
Oct 25 16:20:35 user nova-compute[74048]:   </guest>
Oct 25 16:20:35 user nova-compute[74048]: </capabilities>
Oct 25 16:20:35 user nova-compute[74048]: 
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-i440fx-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>i686</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='255'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'/>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='lm'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ide</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-q35-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>i686</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='288'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'/>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='lm'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-q35-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>i686</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='288'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'/>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='lm'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-i440fx-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>i686</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='255'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'/>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='lm'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ide</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-i440fx-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>x86_64</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='255'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>efi</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='invtsc'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='rsba'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ide</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-q35-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>x86_64</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='288'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>efi</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='invtsc'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='rsba'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-q35-jammy</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>x86_64</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='288'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>efi</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='invtsc'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='rsba'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 25 16:20:35 user nova-compute[74048]: <domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 16:20:35 user nova-compute[74048]:   <domain>kvm</domain>
Oct 25 16:20:35 user nova-compute[74048]:   <machine>pc-i440fx-6.2</machine>
Oct 25 16:20:35 user nova-compute[74048]:   <arch>x86_64</arch>
Oct 25 16:20:35 user nova-compute[74048]:   <vcpu max='255'/>
Oct 25 16:20:35 user nova-compute[74048]:   <iothreads supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:   <os supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='firmware'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>efi</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:     <loader supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>rom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pflash</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='readonly'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>yes</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='secure'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>no</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </loader>
Oct 25 16:20:35 user nova-compute[74048]:   </os>
Oct 25 16:20:35 user nova-compute[74048]:   <cpu>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-passthrough' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='hostPassthroughMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='maximum' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='maximumMigratable'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>on</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>off</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='host-model' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <vendor>Intel</vendor>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ss'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='vmx'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pcid'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='hypervisor'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arat'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='umip'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='md-clear'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='invtsc'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibpb'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='ibrs'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-stibp'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='rsba'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='erms'/>
Oct 25 16:20:35 user nova-compute[74048]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:     <mode name='custom' supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>qemu64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>qemu32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>phenom</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>pentium</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>n270</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm64</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>kvm32</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>coreduo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>core2duo</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>athlon</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Westmere</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Snowridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Skylake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>SandyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Penryn</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G5</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G4</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G3</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Opteron_G2</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Opteron_G1</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>IvyBridge</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Icelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Haswell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Rome</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-Milan</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>EPYC</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Dhyana</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cooperlake</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>Conroe</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='no'>Broadwell</model>
Oct 25 16:20:35 user nova-compute[74048]:       <model usable='yes'>486</model>
Oct 25 16:20:35 user nova-compute[74048]:     </mode>
Oct 25 16:20:35 user nova-compute[74048]:   </cpu>
Oct 25 16:20:35 user nova-compute[74048]:   <memoryBacking supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:     <enum name='sourceType'>
Oct 25 16:20:35 user nova-compute[74048]:       <value>file</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>anonymous</value>
Oct 25 16:20:35 user nova-compute[74048]:       <value>memfd</value>
Oct 25 16:20:35 user nova-compute[74048]:     </enum>
Oct 25 16:20:35 user nova-compute[74048]:   </memoryBacking>
Oct 25 16:20:35 user nova-compute[74048]:   <devices>
Oct 25 16:20:35 user nova-compute[74048]:     <disk supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='diskDevice'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>disk</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cdrom</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>floppy</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>lun</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='bus'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ide</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>fdc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sata</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </disk>
Oct 25 16:20:35 user nova-compute[74048]:     <graphics supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='type'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>sdl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vnc</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>spice</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egl-headless</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </graphics>
Oct 25 16:20:35 user nova-compute[74048]:     <video supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='modelType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>cirrus</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>vmvga</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>qxl</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>none</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>bochs</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>ramfb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </video>
Oct 25 16:20:35 user nova-compute[74048]:     <hostdev supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='mode'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>subsystem</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='startupPolicy'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>default</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>mandatory</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>requisite</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>optional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='subsysType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>usb</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>pci</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>scsi</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='capsType'/>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='pciBackend'/>
Oct 25 16:20:35 user nova-compute[74048]:     </hostdev>
Oct 25 16:20:35 user nova-compute[74048]:     <rng supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtio-non-transitional</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>random</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>egd</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>builtin</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </rng>
Oct 25 16:20:35 user nova-compute[74048]:     <filesystem supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='driverType'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>path</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>handle</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>virtiofs</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </filesystem>
Oct 25 16:20:35 user nova-compute[74048]:     <tpm supported='yes'>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='model'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-tis</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>tpm-crb</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:       <enum name='backendModel'>
Oct 25 16:20:35 user nova-compute[74048]:         <value>passthrough</value>
Oct 25 16:20:35 user nova-compute[74048]:         <value>emulator</value>
Oct 25 16:20:35 user nova-compute[74048]:       </enum>
Oct 25 16:20:35 user nova-compute[74048]:     </tpm>
Oct 25 16:20:35 user nova-compute[74048]:   </devices>
Oct 25 16:20:35 user nova-compute[74048]:   <features>
Oct 25 16:20:35 user nova-compute[74048]:     <gic supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:     <vmcoreinfo supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <genid supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backingStoreInput supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <backup supported='yes'/>
Oct 25 16:20:35 user nova-compute[74048]:     <sev supported='no'/>
Oct 25 16:20:35 user nova-compute[74048]:   </features>
Oct 25 16:20:35 user nova-compute[74048]: </domainCapabilities>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74048) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74048) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Checking secure boot support for host arch (x86_64) {{(pid=74048) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Checking secure boot support for host arch (x86_64) {{(pid=74048) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Checking secure boot support for host arch (x86_64) {{(pid=74048) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 16:20:35 user nova-compute[74048]: INFO nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Secure Boot support detected
Oct 25 16:20:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] cpu compare xml: <cpu match="exact">
Oct 25 16:20:35 user nova-compute[74048]:   <model>Nehalem</model>
Oct 25 16:20:35 user nova-compute[74048]: </cpu>
Oct 25 16:20:35 user nova-compute[74048]:  {{(pid=74048) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 25 16:20:35 user nova-compute[74048]: INFO nova.virt.node [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Generated node identity 8251593b-3c2f-4879-90c3-e2a310c2e6f2
Oct 25 16:20:35 user nova-compute[74048]: INFO nova.virt.node [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Wrote node identity 8251593b-3c2f-4879-90c3-e2a310c2e6f2 to /opt/stack/data/nova/compute_id
Oct 25 16:20:35 user nova-compute[74048]: WARNING nova.compute.manager [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Compute nodes ['8251593b-3c2f-4879-90c3-e2a310c2e6f2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 25 16:20:35 user nova-compute[74048]: INFO nova.compute.manager [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 25 16:20:36 user nova-compute[74048]: WARNING nova.compute.manager [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 16:20:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:20:36 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:20:36 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Hypervisor/Node resource view: name=user free_ram=11004MB free_disk=26.27553939819336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:20:36 user nova-compute[74048]: WARNING nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] No compute node record for user:8251593b-3c2f-4879-90c3-e2a310c2e6f2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8251593b-3c2f-4879-90c3-e2a310c2e6f2 could not be found.
Oct 25 16:20:36 user nova-compute[74048]: INFO nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Compute node record created for user:user with uuid: 8251593b-3c2f-4879-90c3-e2a310c2e6f2
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:20:36 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] [req-1b89b469-e43c-45ff-9b15-ad4464e6cbd5] Created resource provider record via placement API for resource provider with UUID 8251593b-3c2f-4879-90c3-e2a310c2e6f2 and name user.
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74048) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 25 16:20:36 user nova-compute[74048]: INFO nova.virt.libvirt.host [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] kernel doesn't support AMD SEV
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Libvirt baseline CPU <cpu>
Oct 25 16:20:36 user nova-compute[74048]:   <arch>x86_64</arch>
Oct 25 16:20:36 user nova-compute[74048]:   <model>Nehalem</model>
Oct 25 16:20:36 user nova-compute[74048]:   <vendor>Intel</vendor>
Oct 25 16:20:36 user nova-compute[74048]:   <topology sockets="6" cores="1" threads="1"/>
Oct 25 16:20:36 user nova-compute[74048]: </cpu>
Oct 25 16:20:36 user nova-compute[74048]:  {{(pid=74048) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Updated inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Updating resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 generation from 0 to 1 during operation: update_inventory {{(pid=74048) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Updating resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 generation from 1 to 2 during operation: update_traits {{(pid=74048) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.service [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Creating RPC server for service compute {{(pid=74048) start /opt/stack/nova/nova/service.py:182}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.service [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] Join ServiceGroup membership for this service compute {{(pid=74048) start /opt/stack/nova/nova/service.py:199}}
Oct 25 16:20:36 user nova-compute[74048]: DEBUG nova.servicegroup.drivers.db [None req-9e09f918-2cdb-449b-bbb3-87b623be5332 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74048) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 25 16:20:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:20:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:21:27 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:21:28 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:21:28 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:21:28 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=10418MB free_disk=26.179183959960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:21:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:22:29 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:22:30 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:22:30 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:22:30 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=10323MB free_disk=26.23028564453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:22:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:23:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:23:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:23:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:23:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:23:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:23:31 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:23:32 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:23:32 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:23:32 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=25.996841430664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:23:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:24:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:24:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:24:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:24:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:30 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:24:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:24:32 user nova-compute[74048]: INFO nova.compute.claims [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Claim successful on node user
Oct 25 16:24:32 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:24:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:24:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Creating image(s)
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:33 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG nova.policy [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ff1b26939b49ba88fe0105bec65fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931f649d6b844bbdaec9f1b97ab1112c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.part --force-share --output=json" returned: 0 in 0.421s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG nova.virt.images [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] 67778d28-28b7-4dc4-a7ab-187332587d81 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.part /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:24:34 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:34 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:34 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9527MB free_disk=26.015544891357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.part /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.converted" returned: 0 in 0.445s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.356s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:24:35 user nova-compute[74048]: INFO nova.compute.claims [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Claim successful on node user
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7.converted --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.661s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:35 user nova-compute[74048]: INFO oslo.privsep.daemon [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppc7cxnib/privsep.sock']
Oct 25 16:24:35 user sudo[83288]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppc7cxnib/privsep.sock
Oct 25 16:24:35 user sudo[83288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:24:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:24:36 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:24:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:24:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:24:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:24:36 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Creating image(s)
Oct 25 16:24:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:36 user nova-compute[74048]: DEBUG nova.policy [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ff1b26939b49ba88fe0105bec65fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931f649d6b844bbdaec9f1b97ab1112c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:24:37 user sudo[83288]: pam_unix(sudo:session): session closed for user root
Oct 25 16:24:37 user nova-compute[74048]: INFO oslo.privsep.daemon [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Spawned new privsep daemon via rootwrap
Oct 25 16:24:37 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 16:24:37 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 16:24:37 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 25 16:24:37 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83294
Oct 25 16:24:37 user nova-compute[74048]: WARNING oslo_privsep.priv_context [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] privsep daemon already running
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Successfully created port: 9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk 1073741824" returned: 0 in 0.044s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.224s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:24:37 user nova-compute[74048]: INFO nova.compute.claims [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Claim successful on node user
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk 1073741824" returned: 0 in 0.049s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Cannot resize image /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Ensure instance console log exists: /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.network.neutron [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Successfully created port: d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:24:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Cannot resize image /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Ensure instance console log exists: /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:24:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Creating image(s)
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "/opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "/opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "/opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG nova.policy [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdc6b8b203b7400891da6e8336037245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce79847adab49c1b6b03facc193bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.228s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk 1073741824" returned: 0 in 0.089s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Cannot resize image /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Ensure instance console log exists: /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Successfully updated port: 9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-changed-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Refreshing instance network info cache due to event network-changed-9730b0be-a374-415e-8132-58e629dd7caf. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:24:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Successfully updated port: d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Successfully created port: 57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance network_info: |[{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.neutron [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Refreshing network info cache for port 9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Start _get_guest_xml network_info=[{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:24:41 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:41 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-924952119',display_name='tempest-ServerRescueNegativeTestJSON-server-924952119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-924952119',id=1,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-uqtezwev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:34Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=f436dc02-f6f1-4e54-8d87-608a462a107c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.objects.instance [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'pci_devices' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-changed-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Refreshing instance network info cache due to event network-changed-d42debd6-9c21-464b-84ed-1207ba8480bb. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] Acquiring lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:24:41 user nova-compute[74048]:   <uuid>f436dc02-f6f1-4e54-8d87-608a462a107c</uuid>
Oct 25 16:24:41 user nova-compute[74048]:   <name>instance-00000001</name>
Oct 25 16:24:41 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:24:41 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:24:41 user nova-compute[74048]:   <metadata>
Oct 25 16:24:41 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:24:41 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:24:41 user nova-compute[74048]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-924952119</nova:name>
Oct 25 16:24:41 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:24:41</nova:creationTime>
Oct 25 16:24:41 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:24:41 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:24:41 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:24:41 user nova-compute[74048]:       <nova:owner>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:user uuid="94ff1b26939b49ba88fe0105bec65fc2">tempest-ServerRescueNegativeTestJSON-1121503960-project-member</nova:user>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:project uuid="931f649d6b844bbdaec9f1b97ab1112c">tempest-ServerRescueNegativeTestJSON-1121503960</nova:project>
Oct 25 16:24:41 user nova-compute[74048]:       </nova:owner>
Oct 25 16:24:41 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:24:41 user nova-compute[74048]:       <nova:ports>
Oct 25 16:24:41 user nova-compute[74048]:         <nova:port uuid="9730b0be-a374-415e-8132-58e629dd7caf">
Oct 25 16:24:41 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 16:24:41 user nova-compute[74048]:         </nova:port>
Oct 25 16:24:41 user nova-compute[74048]:       </nova:ports>
Oct 25 16:24:41 user nova-compute[74048]:     </nova:instance>
Oct 25 16:24:41 user nova-compute[74048]:   </metadata>
Oct 25 16:24:41 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:24:41 user nova-compute[74048]:     <system>
Oct 25 16:24:41 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:24:41 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:24:41 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:24:41 user nova-compute[74048]:       <entry name="serial">f436dc02-f6f1-4e54-8d87-608a462a107c</entry>
Oct 25 16:24:41 user nova-compute[74048]:       <entry name="uuid">f436dc02-f6f1-4e54-8d87-608a462a107c</entry>
Oct 25 16:24:41 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:24:41 user nova-compute[74048]:     </system>
Oct 25 16:24:41 user nova-compute[74048]:   </sysinfo>
Oct 25 16:24:41 user nova-compute[74048]:   <os>
Oct 25 16:24:41 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:24:41 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:24:41 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:24:41 user nova-compute[74048]:   </os>
Oct 25 16:24:41 user nova-compute[74048]:   <features>
Oct 25 16:24:41 user nova-compute[74048]:     <acpi/>
Oct 25 16:24:41 user nova-compute[74048]:     <apic/>
Oct 25 16:24:41 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:24:41 user nova-compute[74048]:   </features>
Oct 25 16:24:41 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:24:41 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:24:41 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:24:41 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:24:41 user nova-compute[74048]:   </clock>
Oct 25 16:24:41 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:24:41 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:24:41 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:24:41 user nova-compute[74048]:   </cpu>
Oct 25 16:24:41 user nova-compute[74048]:   <devices>
Oct 25 16:24:41 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:24:41 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:24:41 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk"/>
Oct 25 16:24:41 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:24:41 user nova-compute[74048]:     </disk>
Oct 25 16:24:41 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:24:41 user nova-compute[74048]:       <mac address="fa:16:3e:5f:0c:f4"/>
Oct 25 16:24:41 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:41 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:24:41 user nova-compute[74048]:       <target dev="tap9730b0be-a3"/>
Oct 25 16:24:41 user nova-compute[74048]:     </interface>
Oct 25 16:24:41 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:24:41 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/console.log" append="off"/>
Oct 25 16:24:41 user nova-compute[74048]:     </serial>
Oct 25 16:24:41 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:24:41 user nova-compute[74048]:     <video>
Oct 25 16:24:41 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:41 user nova-compute[74048]:     </video>
Oct 25 16:24:41 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:24:41 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:24:41 user nova-compute[74048]:     </rng>
Oct 25 16:24:41 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:24:41 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:24:41 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:24:41 user nova-compute[74048]:     </memballoon>
Oct 25 16:24:41 user nova-compute[74048]:   </devices>
Oct 25 16:24:41 user nova-compute[74048]: </domain>
Oct 25 16:24:41 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-924952119',display_name='tempest-ServerRescueNegativeTestJSON-server-924952119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-924952119',id=1,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-uqtezwev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:34Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=f436dc02-f6f1-4e54-8d87-608a462a107c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG os_vif [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Created schema index Interface.name {{(pid=74048) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Created schema index Port.name {{(pid=74048) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Created schema index Bridge.name {{(pid=74048) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [POLLOUT] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17bffbc8-a8cc-5060-ad80-e43ca0e276c7', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:41 user nova-compute[74048]: INFO oslo.privsep.daemon [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxed_dn_s/privsep.sock']
Oct 25 16:24:41 user sudo[83372]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxed_dn_s/privsep.sock
Oct 25 16:24:41 user sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.neutron [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updated VIF entry in instance network info cache for port 9730b0be-a374-415e-8132-58e629dd7caf. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.neutron [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-877baef2-a9d5-4dae-98c9-2a105e96ef59 req-9b5ae1f9-f7c0-4177-a47e-4fcb595ecdd3 service nova] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance network_info: |[{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] Acquired lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.neutron [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Refreshing network info cache for port d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Start _get_guest_xml network_info=[{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:24:42 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:42 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1245678211',display_name='tempest-ServerRescueNegativeTestJSON-server-1245678211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1245678211',id=2,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-7uvu50qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:36Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=51f3e782-7fc1-4de3-9d74-1d29f3ef9054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.objects.instance [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'pci_devices' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:24:42 user nova-compute[74048]:   <uuid>51f3e782-7fc1-4de3-9d74-1d29f3ef9054</uuid>
Oct 25 16:24:42 user nova-compute[74048]:   <name>instance-00000002</name>
Oct 25 16:24:42 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:24:42 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:24:42 user nova-compute[74048]:   <metadata>
Oct 25 16:24:42 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:24:42 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:24:42 user nova-compute[74048]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1245678211</nova:name>
Oct 25 16:24:42 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:24:42</nova:creationTime>
Oct 25 16:24:42 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:24:42 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:24:42 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:24:42 user nova-compute[74048]:       <nova:owner>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:user uuid="94ff1b26939b49ba88fe0105bec65fc2">tempest-ServerRescueNegativeTestJSON-1121503960-project-member</nova:user>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:project uuid="931f649d6b844bbdaec9f1b97ab1112c">tempest-ServerRescueNegativeTestJSON-1121503960</nova:project>
Oct 25 16:24:42 user nova-compute[74048]:       </nova:owner>
Oct 25 16:24:42 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:24:42 user nova-compute[74048]:       <nova:ports>
Oct 25 16:24:42 user nova-compute[74048]:         <nova:port uuid="d42debd6-9c21-464b-84ed-1207ba8480bb">
Oct 25 16:24:42 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 16:24:42 user nova-compute[74048]:         </nova:port>
Oct 25 16:24:42 user nova-compute[74048]:       </nova:ports>
Oct 25 16:24:42 user nova-compute[74048]:     </nova:instance>
Oct 25 16:24:42 user nova-compute[74048]:   </metadata>
Oct 25 16:24:42 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:24:42 user nova-compute[74048]:     <system>
Oct 25 16:24:42 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:24:42 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:24:42 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:24:42 user nova-compute[74048]:       <entry name="serial">51f3e782-7fc1-4de3-9d74-1d29f3ef9054</entry>
Oct 25 16:24:42 user nova-compute[74048]:       <entry name="uuid">51f3e782-7fc1-4de3-9d74-1d29f3ef9054</entry>
Oct 25 16:24:42 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:24:42 user nova-compute[74048]:     </system>
Oct 25 16:24:42 user nova-compute[74048]:   </sysinfo>
Oct 25 16:24:42 user nova-compute[74048]:   <os>
Oct 25 16:24:42 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:24:42 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:24:42 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:24:42 user nova-compute[74048]:   </os>
Oct 25 16:24:42 user nova-compute[74048]:   <features>
Oct 25 16:24:42 user nova-compute[74048]:     <acpi/>
Oct 25 16:24:42 user nova-compute[74048]:     <apic/>
Oct 25 16:24:42 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:24:42 user nova-compute[74048]:   </features>
Oct 25 16:24:42 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:24:42 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:24:42 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:24:42 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:24:42 user nova-compute[74048]:   </clock>
Oct 25 16:24:42 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:24:42 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:24:42 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:24:42 user nova-compute[74048]:   </cpu>
Oct 25 16:24:42 user nova-compute[74048]:   <devices>
Oct 25 16:24:42 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:24:42 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:24:42 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk"/>
Oct 25 16:24:42 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:24:42 user nova-compute[74048]:     </disk>
Oct 25 16:24:42 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:24:42 user nova-compute[74048]:       <mac address="fa:16:3e:70:14:eb"/>
Oct 25 16:24:42 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:42 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:24:42 user nova-compute[74048]:       <target dev="tapd42debd6-9c"/>
Oct 25 16:24:42 user nova-compute[74048]:     </interface>
Oct 25 16:24:42 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:24:42 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/console.log" append="off"/>
Oct 25 16:24:42 user nova-compute[74048]:     </serial>
Oct 25 16:24:42 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:24:42 user nova-compute[74048]:     <video>
Oct 25 16:24:42 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:42 user nova-compute[74048]:     </video>
Oct 25 16:24:42 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:24:42 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:24:42 user nova-compute[74048]:     </rng>
Oct 25 16:24:42 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:24:42 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:24:42 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:24:42 user nova-compute[74048]:     </memballoon>
Oct 25 16:24:42 user nova-compute[74048]:   </devices>
Oct 25 16:24:42 user nova-compute[74048]: </domain>
Oct 25 16:24:42 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1245678211',display_name='tempest-ServerRescueNegativeTestJSON-server-1245678211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1245678211',id=2,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-7uvu50qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:36Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=51f3e782-7fc1-4de3-9d74-1d29f3ef9054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG os_vif [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0865a79f-8745-535c-ac71-ad893b832a3b', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user sudo[83372]: pam_unix(sudo:session): session closed for user root
Oct 25 16:24:43 user nova-compute[74048]: INFO oslo.privsep.daemon [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Spawned new privsep daemon via rootwrap
Oct 25 16:24:43 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 16:24:43 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 16:24:43 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 25 16:24:43 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83385
Oct 25 16:24:43 user nova-compute[74048]: WARNING oslo_privsep.priv_context [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] privsep daemon already running
Oct 25 16:24:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:24:43 user nova-compute[74048]: INFO nova.compute.claims [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Claim successful on node user
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd42debd6-9c, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd42debd6-9c, col_values=(('qos', UUID('272b5441-04d0-4e91-bcf2-3f297faafaab')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd42debd6-9c, col_values=(('external_ids', {'iface-id': 'd42debd6-9c21-464b-84ed-1207ba8480bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:14:eb', 'vm-uuid': '51f3e782-7fc1-4de3-9d74-1d29f3ef9054'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user nova-compute[74048]: INFO os_vif [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c')
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9730b0be-a3, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9730b0be-a3, col_values=(('qos', UUID('32e74f14-620b-4b65-ad45-4ffdae7ed23a')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9730b0be-a3, col_values=(('external_ids', {'iface-id': '9730b0be-a374-415e-8132-58e629dd7caf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:0c:f4', 'vm-uuid': 'f436dc02-f6f1-4e54-8d87-608a462a107c'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:43 user nova-compute[74048]: INFO os_vif [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3')
Oct 25 16:24:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Successfully updated port: 57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:24:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:70:14:eb, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:5f:0c:f4, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "refresh_cache-c363340c-e38a-4627-8ad5-d8a2a5cb11ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquired lock "refresh_cache-c363340c-e38a-4627-8ad5-d8a2a5cb11ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-changed-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Refreshing instance network info cache due to event network-changed-57c5d0c7-82b5-456c-bddb-4961e048b5db. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] Acquiring lock "refresh_cache-c363340c-e38a-4627-8ad5-d8a2a5cb11ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updated VIF entry in instance network info cache for port d42debd6-9c21-464b-84ed-1207ba8480bb. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ad0807ec-ab9e-4362-a7c4-8f3fe1bd6675 req-1b6be675-6cac-4198-ac0a-6180f6c64274 service nova] Releasing lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:24:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Creating image(s)
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "/opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "/opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "/opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.222s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG nova.policy [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c809d630a78d4ce4bef9a9462543d2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad2347aaae1424681b490608fde8b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk 1073741824" returned: 0 in 0.056s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.248s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Cannot resize image /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Ensure instance console log exists: /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Updating instance_info_cache with network_info: [{"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Releasing lock "refresh_cache-c363340c-e38a-4627-8ad5-d8a2a5cb11ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Instance network_info: |[{"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] Acquired lock "refresh_cache-c363340c-e38a-4627-8ad5-d8a2a5cb11ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Refreshing network info cache for port 57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Start _get_guest_xml network_info=[{"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:24:45 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:45 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1059039460',display_name='tempest-DeleteServersTestJSON-server-1059039460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1059039460',id=3,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ce79847adab49c1b6b03facc193bacd',ramdisk_id='',reservation_id='r-jr0mnl5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1203378366',owner_user_name='tempest-DeleteServersTestJSON-1203378366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:38Z,user_data=None,user_id='fdc6b8b203b7400891da6e8336037245',uuid=c363340c-e38a-4627-8ad5-d8a2a5cb11ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Converting VIF {"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lazy-loading 'pci_devices' on Instance uuid c363340c-e38a-4627-8ad5-d8a2a5cb11ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:24:45 user nova-compute[74048]:   <uuid>c363340c-e38a-4627-8ad5-d8a2a5cb11ac</uuid>
Oct 25 16:24:45 user nova-compute[74048]:   <name>instance-00000003</name>
Oct 25 16:24:45 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:24:45 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:24:45 user nova-compute[74048]:   <metadata>
Oct 25 16:24:45 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:24:45 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:24:45 user nova-compute[74048]:       <nova:name>tempest-DeleteServersTestJSON-server-1059039460</nova:name>
Oct 25 16:24:45 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:24:45</nova:creationTime>
Oct 25 16:24:45 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:24:45 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:24:45 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:24:45 user nova-compute[74048]:       <nova:owner>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:user uuid="fdc6b8b203b7400891da6e8336037245">tempest-DeleteServersTestJSON-1203378366-project-member</nova:user>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:project uuid="1ce79847adab49c1b6b03facc193bacd">tempest-DeleteServersTestJSON-1203378366</nova:project>
Oct 25 16:24:45 user nova-compute[74048]:       </nova:owner>
Oct 25 16:24:45 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:24:45 user nova-compute[74048]:       <nova:ports>
Oct 25 16:24:45 user nova-compute[74048]:         <nova:port uuid="57c5d0c7-82b5-456c-bddb-4961e048b5db">
Oct 25 16:24:45 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 16:24:45 user nova-compute[74048]:         </nova:port>
Oct 25 16:24:45 user nova-compute[74048]:       </nova:ports>
Oct 25 16:24:45 user nova-compute[74048]:     </nova:instance>
Oct 25 16:24:45 user nova-compute[74048]:   </metadata>
Oct 25 16:24:45 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:24:45 user nova-compute[74048]:     <system>
Oct 25 16:24:45 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:24:45 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:24:45 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:24:45 user nova-compute[74048]:       <entry name="serial">c363340c-e38a-4627-8ad5-d8a2a5cb11ac</entry>
Oct 25 16:24:45 user nova-compute[74048]:       <entry name="uuid">c363340c-e38a-4627-8ad5-d8a2a5cb11ac</entry>
Oct 25 16:24:45 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:24:45 user nova-compute[74048]:     </system>
Oct 25 16:24:45 user nova-compute[74048]:   </sysinfo>
Oct 25 16:24:45 user nova-compute[74048]:   <os>
Oct 25 16:24:45 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:24:45 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:24:45 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:24:45 user nova-compute[74048]:   </os>
Oct 25 16:24:45 user nova-compute[74048]:   <features>
Oct 25 16:24:45 user nova-compute[74048]:     <acpi/>
Oct 25 16:24:45 user nova-compute[74048]:     <apic/>
Oct 25 16:24:45 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:24:45 user nova-compute[74048]:   </features>
Oct 25 16:24:45 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:24:45 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:24:45 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:24:45 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:24:45 user nova-compute[74048]:   </clock>
Oct 25 16:24:45 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:24:45 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:24:45 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:24:45 user nova-compute[74048]:   </cpu>
Oct 25 16:24:45 user nova-compute[74048]:   <devices>
Oct 25 16:24:45 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:24:45 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:24:45 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk"/>
Oct 25 16:24:45 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:24:45 user nova-compute[74048]:     </disk>
Oct 25 16:24:45 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:24:45 user nova-compute[74048]:       <mac address="fa:16:3e:be:ec:71"/>
Oct 25 16:24:45 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:45 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:24:45 user nova-compute[74048]:       <target dev="tap57c5d0c7-82"/>
Oct 25 16:24:45 user nova-compute[74048]:     </interface>
Oct 25 16:24:45 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:24:45 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/console.log" append="off"/>
Oct 25 16:24:45 user nova-compute[74048]:     </serial>
Oct 25 16:24:45 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:24:45 user nova-compute[74048]:     <video>
Oct 25 16:24:45 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:45 user nova-compute[74048]:     </video>
Oct 25 16:24:45 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:24:45 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:24:45 user nova-compute[74048]:     </rng>
Oct 25 16:24:45 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:24:45 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:24:45 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:24:45 user nova-compute[74048]:     </memballoon>
Oct 25 16:24:45 user nova-compute[74048]:   </devices>
Oct 25 16:24:45 user nova-compute[74048]: </domain>
Oct 25 16:24:45 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1059039460',display_name='tempest-DeleteServersTestJSON-server-1059039460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1059039460',id=3,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ce79847adab49c1b6b03facc193bacd',ramdisk_id='',reservation_id='r-jr0mnl5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1203378366',owner_user_name='tempest-DeleteServersTestJSON-1203378366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:38Z,user_data=None,user_id='fdc6b8b203b7400891da6e8336037245',uuid=c363340c-e38a-4627-8ad5-d8a2a5cb11ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Converting VIF {"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG os_vif [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dfd04f2-c4b9-5069-8d6c-c8b0c32839b0', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57c5d0c7-82, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57c5d0c7-82, col_values=(('qos', UUID('b059135d-9f66-4dd1-b391-a521e70b59d4')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57c5d0c7-82, col_values=(('external_ids', {'iface-id': '57c5d0c7-82b5-456c-bddb-4961e048b5db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ec:71', 'vm-uuid': 'c363340c-e38a-4627-8ad5-d8a2a5cb11ac'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:45 user nova-compute[74048]: INFO os_vif [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82')
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:24:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] No VIF found with MAC fa:16:3e:be:ec:71, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG nova.network.neutron [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Updated VIF entry in instance network info cache for port 57c5d0c7-82b5-456c-bddb-4961e048b5db. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG nova.network.neutron [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Updating instance_info_cache with network_info: [{"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2d6b00fe-7aef-4a92-be69-14ec9a78455f req-a9c6c422-043f-46d2-b252-0be5827041e6 service nova] Releasing lock "refresh_cache-c363340c-e38a-4627-8ad5-d8a2a5cb11ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Successfully created port: cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Successfully updated port: cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-changed-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Refreshing instance network info cache due to event network-changed-cba57bbe-a7a5-4d0f-981d-66bcd9d81974. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Instance network_info: |[{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.network.neutron [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Refreshing network info cache for port cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Start _get_guest_xml network_info=[{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:24:50 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:50 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-140518444',display_name='tempest-ServerActionsTestOtherA-server-140518444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-140518444',id=4,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-cztxuniz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=85b4351f-c0e6-4fb8-9607-e0d8eb017ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:24:50 user nova-compute[74048]:   <uuid>85b4351f-c0e6-4fb8-9607-e0d8eb017ee2</uuid>
Oct 25 16:24:50 user nova-compute[74048]:   <name>instance-00000004</name>
Oct 25 16:24:50 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:24:50 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:24:50 user nova-compute[74048]:   <metadata>
Oct 25 16:24:50 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:24:50 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:24:50 user nova-compute[74048]:       <nova:name>tempest-ServerActionsTestOtherA-server-140518444</nova:name>
Oct 25 16:24:50 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:24:50</nova:creationTime>
Oct 25 16:24:50 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:24:50 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:24:50 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:24:50 user nova-compute[74048]:       <nova:owner>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:user uuid="c809d630a78d4ce4bef9a9462543d2ad">tempest-ServerActionsTestOtherA-318048713-project-member</nova:user>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:project uuid="8ad2347aaae1424681b490608fde8b08">tempest-ServerActionsTestOtherA-318048713</nova:project>
Oct 25 16:24:50 user nova-compute[74048]:       </nova:owner>
Oct 25 16:24:50 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:24:50 user nova-compute[74048]:       <nova:ports>
Oct 25 16:24:50 user nova-compute[74048]:         <nova:port uuid="cba57bbe-a7a5-4d0f-981d-66bcd9d81974">
Oct 25 16:24:50 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 16:24:50 user nova-compute[74048]:         </nova:port>
Oct 25 16:24:50 user nova-compute[74048]:       </nova:ports>
Oct 25 16:24:50 user nova-compute[74048]:     </nova:instance>
Oct 25 16:24:50 user nova-compute[74048]:   </metadata>
Oct 25 16:24:50 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:24:50 user nova-compute[74048]:     <system>
Oct 25 16:24:50 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:24:50 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:24:50 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:24:50 user nova-compute[74048]:       <entry name="serial">85b4351f-c0e6-4fb8-9607-e0d8eb017ee2</entry>
Oct 25 16:24:50 user nova-compute[74048]:       <entry name="uuid">85b4351f-c0e6-4fb8-9607-e0d8eb017ee2</entry>
Oct 25 16:24:50 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:24:50 user nova-compute[74048]:     </system>
Oct 25 16:24:50 user nova-compute[74048]:   </sysinfo>
Oct 25 16:24:50 user nova-compute[74048]:   <os>
Oct 25 16:24:50 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:24:50 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:24:50 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:24:50 user nova-compute[74048]:   </os>
Oct 25 16:24:50 user nova-compute[74048]:   <features>
Oct 25 16:24:50 user nova-compute[74048]:     <acpi/>
Oct 25 16:24:50 user nova-compute[74048]:     <apic/>
Oct 25 16:24:50 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:24:50 user nova-compute[74048]:   </features>
Oct 25 16:24:50 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:24:50 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:24:50 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:24:50 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:24:50 user nova-compute[74048]:   </clock>
Oct 25 16:24:50 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:24:50 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:24:50 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:24:50 user nova-compute[74048]:   </cpu>
Oct 25 16:24:50 user nova-compute[74048]:   <devices>
Oct 25 16:24:50 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:24:50 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:24:50 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk"/>
Oct 25 16:24:50 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:24:50 user nova-compute[74048]:     </disk>
Oct 25 16:24:50 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:24:50 user nova-compute[74048]:       <mac address="fa:16:3e:b9:36:b0"/>
Oct 25 16:24:50 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:50 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:24:50 user nova-compute[74048]:       <target dev="tapcba57bbe-a7"/>
Oct 25 16:24:50 user nova-compute[74048]:     </interface>
Oct 25 16:24:50 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:24:50 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/console.log" append="off"/>
Oct 25 16:24:50 user nova-compute[74048]:     </serial>
Oct 25 16:24:50 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:24:50 user nova-compute[74048]:     <video>
Oct 25 16:24:50 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:24:50 user nova-compute[74048]:     </video>
Oct 25 16:24:50 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:24:50 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:24:50 user nova-compute[74048]:     </rng>
Oct 25 16:24:50 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:24:50 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:24:50 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:24:50 user nova-compute[74048]:     </memballoon>
Oct 25 16:24:50 user nova-compute[74048]:   </devices>
Oct 25 16:24:50 user nova-compute[74048]: </domain>
Oct 25 16:24:50 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-140518444',display_name='tempest-ServerActionsTestOtherA-server-140518444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-140518444',id=4,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-cztxuniz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=85b4351f-c0e6-4fb8-9607-e0d8eb017ee2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG os_vif [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27d368b9-8bef-5dd4-8734-8accffd92b5a', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcba57bbe-a7, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcba57bbe-a7, col_values=(('qos', UUID('ece51ada-1ce2-4bf4-9df5-59b1f7d194ea')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcba57bbe-a7, col_values=(('external_ids', {'iface-id': 'cba57bbe-a7a5-4d0f-981d-66bcd9d81974', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:36:b0', 'vm-uuid': '85b4351f-c0e6-4fb8-9607-e0d8eb017ee2'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:50 user nova-compute[74048]: INFO os_vif [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7')
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:24:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No VIF found with MAC fa:16:3e:b9:36:b0, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:24:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance spawned successfully.
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.network.neutron [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated VIF entry in instance network info cache for port cba57bbe-a7a5-4d0f-981d-66bcd9d81974. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.network.neutron [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-796b8074-d0f3-4ce7-a59d-dd4606a509b9 req-564db2df-827a-4eec-8654-381f34c357fb service nova] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:24:51 user nova-compute[74048]: INFO nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Took 15.39 seconds to spawn the instance on the hypervisor.
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:24:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance spawned successfully.
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:24:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Instance spawned successfully.
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:24:51 user nova-compute[74048]: INFO nova.compute.manager [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Took 16.77 seconds to build instance.
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-53dc0247-1737-4d35-ba22-a9cb2ec3af3c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.078s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:52 user nova-compute[74048]: INFO nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Took 18.14 seconds to spawn the instance on the hypervisor.
Oct 25 16:24:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:24:52 user nova-compute[74048]: INFO nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Took 13.63 seconds to spawn the instance on the hypervisor.
Oct 25 16:24:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:24:52 user nova-compute[74048]: INFO nova.compute.manager [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Took 14.60 seconds to build instance.
Oct 25 16:24:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a8267c7-1d49-44ca-be3a-9001abcfe0c6 tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.742s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:52 user nova-compute[74048]: INFO nova.compute.manager [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Took 19.40 seconds to build instance.
Oct 25 16:24:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-500c4c20-bf0d-44f2-9214-779a7e12ac88 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.650s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-18290ec0-748d-4193-8022-c5f13aa64628 req-00b5e4c5-0d6b-4115-be33-614fb0e54c52 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-18290ec0-748d-4193-8022-c5f13aa64628 req-00b5e4c5-0d6b-4115-be33-614fb0e54c52 service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-18290ec0-748d-4193-8022-c5f13aa64628 req-00b5e4c5-0d6b-4115-be33-614fb0e54c52 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-18290ec0-748d-4193-8022-c5f13aa64628 req-00b5e4c5-0d6b-4115-be33-614fb0e54c52 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-18290ec0-748d-4193-8022-c5f13aa64628 req-00b5e4c5-0d6b-4115-be33-614fb0e54c52 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:24:54 user nova-compute[74048]: WARNING nova.compute.manager [req-18290ec0-748d-4193-8022-c5f13aa64628 req-00b5e4c5-0d6b-4115-be33-614fb0e54c52 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state active and task_state None.
Oct 25 16:24:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:24:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Instance spawned successfully.
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:24:55 user nova-compute[74048]: INFO nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Took 11.10 seconds to spawn the instance on the hypervisor.
Oct 25 16:24:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:24:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:55 user nova-compute[74048]: INFO nova.compute.manager [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Took 11.98 seconds to build instance.
Oct 25 16:24:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f6c62daa-8f00-4aef-8424-7a10d4a3b429 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.167s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:24:56 user nova-compute[74048]: WARNING nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state active and task_state None.
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] No waiting events found dispatching network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:24:56 user nova-compute[74048]: WARNING nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received unexpected event network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db for instance with vm_state active and task_state None.
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] No waiting events found dispatching network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:24:56 user nova-compute[74048]: WARNING nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received unexpected event network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db for instance with vm_state active and task_state None.
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] No waiting events found dispatching network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:24:56 user nova-compute[74048]: WARNING nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received unexpected event network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 for instance with vm_state active and task_state None.
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:24:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] No waiting events found dispatching network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:24:56 user nova-compute[74048]: WARNING nova.compute.manager [req-1b1c7c55-7e8b-42ec-88bb-8782a61227f7 req-c92d8e85-ced1-46f4-aa51-08b97a8132d0 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received unexpected event network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 for instance with vm_state active and task_state None.
Oct 25 16:24:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:24:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:25:02 user nova-compute[74048]: INFO nova.compute.claims [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Claim successful on node user
Oct 25 16:25:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:25:03 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:25:03 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Creating image(s)
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG nova.policy [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d9a5ea3d09a4616b439473e03ec3bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4a9d7ce314c309771155151f1841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.356s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.338s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk 1073741824" returned: 0 in 0.119s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.473s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.262s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:25:04 user nova-compute[74048]: INFO nova.compute.claims [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Claim successful on node user
Oct 25 16:25:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Cannot resize image /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Ensure instance console log exists: /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Successfully created port: 0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:25:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.policy [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e764a620762b42b5a094def003269c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4357e3da93604fd0a784aa60197f688a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:25:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Creating image(s)
Oct 25 16:25:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "/opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "/opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Successfully updated port: 0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-changed-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Refreshing instance network info cache due to event network-changed-0334d634-48ac-4890-a7cc-a85599ae2cef. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.308s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.264s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk 1073741824" returned: 0 in 0.067s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.262s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Instance network_info: |[{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.neutron [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Refreshing network info cache for port 0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Start _get_guest_xml network_info=[{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:25:06 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:06 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'pci_devices' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:25:06 user nova-compute[74048]:   <uuid>25e59513-b3bb-44c2-ac27-f9dcdacffed1</uuid>
Oct 25 16:25:06 user nova-compute[74048]:   <name>instance-00000005</name>
Oct 25 16:25:06 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:25:06 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:25:06 user nova-compute[74048]:   <metadata>
Oct 25 16:25:06 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:25:06 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:25:06 user nova-compute[74048]:       <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:25:06 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:25:06</nova:creationTime>
Oct 25 16:25:06 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:25:06 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:25:06 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:25:06 user nova-compute[74048]:       <nova:owner>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:25:06 user nova-compute[74048]:       </nova:owner>
Oct 25 16:25:06 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:25:06 user nova-compute[74048]:       <nova:ports>
Oct 25 16:25:06 user nova-compute[74048]:         <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:25:06 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:25:06 user nova-compute[74048]:         </nova:port>
Oct 25 16:25:06 user nova-compute[74048]:       </nova:ports>
Oct 25 16:25:06 user nova-compute[74048]:     </nova:instance>
Oct 25 16:25:06 user nova-compute[74048]:   </metadata>
Oct 25 16:25:06 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:25:06 user nova-compute[74048]:     <system>
Oct 25 16:25:06 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:25:06 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:25:06 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:25:06 user nova-compute[74048]:       <entry name="serial">25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:25:06 user nova-compute[74048]:       <entry name="uuid">25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:25:06 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:25:06 user nova-compute[74048]:     </system>
Oct 25 16:25:06 user nova-compute[74048]:   </sysinfo>
Oct 25 16:25:06 user nova-compute[74048]:   <os>
Oct 25 16:25:06 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:25:06 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:25:06 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:25:06 user nova-compute[74048]:   </os>
Oct 25 16:25:06 user nova-compute[74048]:   <features>
Oct 25 16:25:06 user nova-compute[74048]:     <acpi/>
Oct 25 16:25:06 user nova-compute[74048]:     <apic/>
Oct 25 16:25:06 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:25:06 user nova-compute[74048]:   </features>
Oct 25 16:25:06 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:25:06 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:25:06 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:25:06 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:25:06 user nova-compute[74048]:   </clock>
Oct 25 16:25:06 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:25:06 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:25:06 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:25:06 user nova-compute[74048]:   </cpu>
Oct 25 16:25:06 user nova-compute[74048]:   <devices>
Oct 25 16:25:06 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:25:06 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:25:06 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk"/>
Oct 25 16:25:06 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:25:06 user nova-compute[74048]:     </disk>
Oct 25 16:25:06 user nova-compute[74048]:     <disk type="file" device="cdrom">
Oct 25 16:25:06 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 16:25:06 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config"/>
Oct 25 16:25:06 user nova-compute[74048]:       <target dev="hda" bus="ide"/>
Oct 25 16:25:06 user nova-compute[74048]:     </disk>
Oct 25 16:25:06 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:25:06 user nova-compute[74048]:       <mac address="fa:16:3e:96:f9:76"/>
Oct 25 16:25:06 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:06 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:25:06 user nova-compute[74048]:       <target dev="tap0334d634-48"/>
Oct 25 16:25:06 user nova-compute[74048]:     </interface>
Oct 25 16:25:06 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:25:06 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log" append="off"/>
Oct 25 16:25:06 user nova-compute[74048]:     </serial>
Oct 25 16:25:06 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:25:06 user nova-compute[74048]:     <video>
Oct 25 16:25:06 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:06 user nova-compute[74048]:     </video>
Oct 25 16:25:06 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:25:06 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:25:06 user nova-compute[74048]:     </rng>
Oct 25 16:25:06 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:25:06 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:25:06 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:25:06 user nova-compute[74048]:     </memballoon>
Oct 25 16:25:06 user nova-compute[74048]:   </devices>
Oct 25 16:25:06 user nova-compute[74048]: </domain>
Oct 25 16:25:06 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG os_vif [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Cannot resize image /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Ensure instance console log exists: /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67c88cfe-fb95-57af-af88-5becaecbf992', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0334d634-48, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0334d634-48, col_values=(('qos', UUID('e8212d45-917a-4f70-b754-211f7756c6c5')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0334d634-48, col_values=(('external_ids', {'iface-id': '0334d634-48ac-4890-a7cc-a85599ae2cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f9:76', 'vm-uuid': '25e59513-b3bb-44c2-ac27-f9dcdacffed1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:06 user nova-compute[74048]: INFO os_vif [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48')
Oct 25 16:25:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No BDM found with device name hda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No VIF found with MAC fa:16:3e:96:f9:76, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:25:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Using config drive
Oct 25 16:25:07 user nova-compute[74048]: DEBUG nova.network.neutron [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updated VIF entry in instance network info cache for port 0334d634-48ac-4890-a7cc-a85599ae2cef. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:25:07 user nova-compute[74048]: DEBUG nova.network.neutron [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-351aa851-c098-411c-91ad-df55da8e8615 req-32891815-4aaa-4628-9e52-c122493b72e2 service nova] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Successfully created port: 9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:25:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Creating config drive at /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config
Oct 25 16:25:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcefcw5y2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcefcw5y2" returned: 0 in 0.060s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Successfully updated port: 9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquired lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-changed-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Refreshing instance network info cache due to event network-changed-9b11a8e3-fd0d-48a8-b258-e6b7db930f11. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] Acquiring lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:25:10 user nova-compute[74048]: INFO nova.compute.claims [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Claim successful on node user
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.network.neutron [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updating instance_info_cache with network_info: [{"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Releasing lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Instance network_info: |[{"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] Acquired lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Refreshing network info cache for port 9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Start _get_guest_xml network_info=[{"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:25:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-398279326',display_name='tempest-VolumesAdminNegativeTest-server-398279326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-398279326',id=6,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtuJSDWOyFU/2HLX01agPN0JLCT0/dV7aLvi9/DKmLTaG8Gi/S/7CvJVXZJD4+wtq1Q9vlQrzysXpE4IRiwWaasPnhdSJGlZD9Gctu5WErJaFQyPgDxxGEvxI4w1elmxg==',key_name='tempest-keypair-1151355184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4357e3da93604fd0a784aa60197f688a',ramdisk_id='',reservation_id='r-ypymlkhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1275180142',owner_user_name='tempest-VolumesAdminNegativeTest-1275180142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e764a620762b42b5a094def003269c4f',uuid=bb58c025-8dec-4804-9b3e-f42a68e8b5ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converting VIF {"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:10 user nova-compute[74048]: DEBUG nova.objects.instance [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'pci_devices' on Instance uuid bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:25:11 user nova-compute[74048]:   <uuid>bb58c025-8dec-4804-9b3e-f42a68e8b5ae</uuid>
Oct 25 16:25:11 user nova-compute[74048]:   <name>instance-00000006</name>
Oct 25 16:25:11 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:25:11 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:25:11 user nova-compute[74048]:   <metadata>
Oct 25 16:25:11 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:25:11 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:25:11 user nova-compute[74048]:       <nova:name>tempest-VolumesAdminNegativeTest-server-398279326</nova:name>
Oct 25 16:25:11 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:25:10</nova:creationTime>
Oct 25 16:25:11 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:25:11 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:25:11 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:25:11 user nova-compute[74048]:       <nova:owner>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:user uuid="e764a620762b42b5a094def003269c4f">tempest-VolumesAdminNegativeTest-1275180142-project-member</nova:user>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:project uuid="4357e3da93604fd0a784aa60197f688a">tempest-VolumesAdminNegativeTest-1275180142</nova:project>
Oct 25 16:25:11 user nova-compute[74048]:       </nova:owner>
Oct 25 16:25:11 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:25:11 user nova-compute[74048]:       <nova:ports>
Oct 25 16:25:11 user nova-compute[74048]:         <nova:port uuid="9b11a8e3-fd0d-48a8-b258-e6b7db930f11">
Oct 25 16:25:11 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:25:11 user nova-compute[74048]:         </nova:port>
Oct 25 16:25:11 user nova-compute[74048]:       </nova:ports>
Oct 25 16:25:11 user nova-compute[74048]:     </nova:instance>
Oct 25 16:25:11 user nova-compute[74048]:   </metadata>
Oct 25 16:25:11 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:25:11 user nova-compute[74048]:     <system>
Oct 25 16:25:11 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:25:11 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:25:11 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:25:11 user nova-compute[74048]:       <entry name="serial">bb58c025-8dec-4804-9b3e-f42a68e8b5ae</entry>
Oct 25 16:25:11 user nova-compute[74048]:       <entry name="uuid">bb58c025-8dec-4804-9b3e-f42a68e8b5ae</entry>
Oct 25 16:25:11 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:25:11 user nova-compute[74048]:     </system>
Oct 25 16:25:11 user nova-compute[74048]:   </sysinfo>
Oct 25 16:25:11 user nova-compute[74048]:   <os>
Oct 25 16:25:11 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:25:11 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:25:11 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:25:11 user nova-compute[74048]:   </os>
Oct 25 16:25:11 user nova-compute[74048]:   <features>
Oct 25 16:25:11 user nova-compute[74048]:     <acpi/>
Oct 25 16:25:11 user nova-compute[74048]:     <apic/>
Oct 25 16:25:11 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:25:11 user nova-compute[74048]:   </features>
Oct 25 16:25:11 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:25:11 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:25:11 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:25:11 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:25:11 user nova-compute[74048]:   </clock>
Oct 25 16:25:11 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:25:11 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:25:11 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:25:11 user nova-compute[74048]:   </cpu>
Oct 25 16:25:11 user nova-compute[74048]:   <devices>
Oct 25 16:25:11 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:25:11 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:25:11 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk"/>
Oct 25 16:25:11 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:25:11 user nova-compute[74048]:     </disk>
Oct 25 16:25:11 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:25:11 user nova-compute[74048]:       <mac address="fa:16:3e:05:33:ff"/>
Oct 25 16:25:11 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:11 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:25:11 user nova-compute[74048]:       <target dev="tap9b11a8e3-fd"/>
Oct 25 16:25:11 user nova-compute[74048]:     </interface>
Oct 25 16:25:11 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:25:11 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/console.log" append="off"/>
Oct 25 16:25:11 user nova-compute[74048]:     </serial>
Oct 25 16:25:11 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:25:11 user nova-compute[74048]:     <video>
Oct 25 16:25:11 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:11 user nova-compute[74048]:     </video>
Oct 25 16:25:11 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:25:11 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:25:11 user nova-compute[74048]:     </rng>
Oct 25 16:25:11 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:25:11 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:25:11 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:25:11 user nova-compute[74048]:     </memballoon>
Oct 25 16:25:11 user nova-compute[74048]:   </devices>
Oct 25 16:25:11 user nova-compute[74048]: </domain>
Oct 25 16:25:11 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-398279326',display_name='tempest-VolumesAdminNegativeTest-server-398279326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-398279326',id=6,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtuJSDWOyFU/2HLX01agPN0JLCT0/dV7aLvi9/DKmLTaG8Gi/S/7CvJVXZJD4+wtq1Q9vlQrzysXpE4IRiwWaasPnhdSJGlZD9Gctu5WErJaFQyPgDxxGEvxI4w1elmxg==',key_name='tempest-keypair-1151355184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4357e3da93604fd0a784aa60197f688a',ramdisk_id='',reservation_id='r-ypymlkhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1275180142',owner_user_name='tempest-VolumesAdminNegativeTest-1275180142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e764a620762b42b5a094def003269c4f',uuid=bb58c025-8dec-4804-9b3e-f42a68e8b5ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converting VIF {"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG os_vif [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbb227dd-b7ad-5659-a1ba-4bb9d862a163', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b11a8e3-fd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b11a8e3-fd, col_values=(('qos', UUID('44ebce6c-d5a6-4726-a377-b85565bcf4b1')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b11a8e3-fd, col_values=(('external_ids', {'iface-id': '9b11a8e3-fd0d-48a8-b258-e6b7db930f11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:33:ff', 'vm-uuid': 'bb58c025-8dec-4804-9b3e-f42a68e8b5ae'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:11 user nova-compute[74048]: INFO os_vif [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd')
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No VIF found with MAC fa:16:3e:05:33:ff, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:25:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:25:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Creating image(s)
Oct 25 16:25:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "/opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "/opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "57d877183e90d2883e593020b9a62e1c41caf278" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "57d877183e90d2883e593020b9a62e1c41caf278" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.policy [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1b0e48155e4cb5b525d5366f59a963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f3896af58054c3a9efa35f9502c8401', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updated VIF entry in instance network info cache for port 9b11a8e3-fd0d-48a8-b258-e6b7db930f11. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updating instance_info_cache with network_info: [{"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.part --force-share --output=json" returned: 0 in 0.225s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.images [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] 6c645f1f-7a81-48fd-8107-7eeb60d46a52 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.part /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9426b3ae-d5e6-4b55-9b7b-c6fa612ece78 req-85e31b5c-bf1a-46ea-92e2-089f3536019e service nova] Releasing lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Instance spawned successfully.
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:25:12 user nova-compute[74048]: INFO nova.compute.claims [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Claim successful on node user
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.part /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.converted" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:12 user nova-compute[74048]: INFO nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Took 9.25 seconds to spawn the instance on the hypervisor.
Oct 25 16:25:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278.converted --force-share --output=json" returned: 0 in 0.244s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "57d877183e90d2883e593020b9a62e1c41caf278" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.145s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:12 user nova-compute[74048]: INFO nova.compute.manager [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Took 10.48 seconds to build instance.
Oct 25 16:25:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f96a463e-1d38-4cb8-9027-d0eec75c3399 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.735s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 --force-share --output=json" returned: 0 in 0.340s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "57d877183e90d2883e593020b9a62e1c41caf278" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "57d877183e90d2883e593020b9a62e1c41caf278" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Successfully created port: c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.882s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278,backing_fmt=raw /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278,backing_fmt=raw /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk 1073741824" returned: 0 in 0.070s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "57d877183e90d2883e593020b9a62e1c41caf278" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 --force-share --output=json" returned: 0 in 0.265s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.policy [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db2248c3eb174326a6d08330d16835ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5b6a583ea94bf18bb0100d3f49b9c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:25:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Creating image(s)
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "/opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "/opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Cannot resize image /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Ensure instance console log exists: /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.234s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk 1073741824" returned: 0 in 0.049s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Cannot resize image /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Ensure instance console log exists: /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Successfully updated port: c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquired lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-changed-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Refreshing instance network info cache due to event network-changed-c5649328-cbf9-459d-9a05-de071a78fc14. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] Acquiring lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:14 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Successfully created port: f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:25:15 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Instance spawned successfully.
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:15 user nova-compute[74048]: INFO nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Took 9.68 seconds to spawn the instance on the hypervisor.
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updating instance_info_cache with network_info: [{"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Releasing lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Instance network_info: |[{"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] Acquired lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.neutron [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Refreshing network info cache for port c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Start _get_guest_xml network_info=[{"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:25:02Z,direct_url=<?>,disk_format='qcow2',id=6c645f1f-7a81-48fd-8107-7eeb60d46a52,min_disk=0,min_ram=0,name='',owner='9ffed4a90f3d4be5aa199194df6bedb2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:25:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'guest_format': None, 'encrypted': False, 'image_id': '6c645f1f-7a81-48fd-8107-7eeb60d46a52'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:25:15 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:15 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:25:02Z,direct_url=<?>,disk_format='qcow2',id=6c645f1f-7a81-48fd-8107-7eeb60d46a52,min_disk=0,min_ram=0,name='',owner='9ffed4a90f3d4be5aa199194df6bedb2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:25:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1200770277',display_name='tempest-AttachSCSIVolumeTestJSON-server-1200770277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1200770277',id=7,image_ref='6c645f1f-7a81-48fd-8107-7eeb60d46a52',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbuxxpsUbCtmo9fboY8JrJ6ox1mlp6Z899bPyn7rDWqnkZ8npgWTcfI/tx3zGEIS+pWBl3bWKjkcwIPMNhoUt5+ZL1zaFA3Odw2INn42elHVYsl51Nrj9iKGwKPd+qfWA==',key_name='tempest-keypair-9011675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f3896af58054c3a9efa35f9502c8401',ramdisk_id='',reservation_id='r-wtwo19ms',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c645f1f-7a81-48fd-8107-7eeb60d46a52',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1025055638',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1025055638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1b0e48155e4cb5b525d5366f59a963',uuid=ddc67032-ea48-4809-9666-510c7f87f320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Converting VIF {"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc67032-ea48-4809-9666-510c7f87f320 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:25:15 user nova-compute[74048]: INFO nova.compute.manager [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Took 11.02 seconds to build instance.
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:25:15 user nova-compute[74048]:   <uuid>ddc67032-ea48-4809-9666-510c7f87f320</uuid>
Oct 25 16:25:15 user nova-compute[74048]:   <name>instance-00000007</name>
Oct 25 16:25:15 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:25:15 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:25:15 user nova-compute[74048]:   <metadata>
Oct 25 16:25:15 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:25:15 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:25:15 user nova-compute[74048]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1200770277</nova:name>
Oct 25 16:25:15 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:25:15</nova:creationTime>
Oct 25 16:25:15 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:25:15 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:25:15 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:25:15 user nova-compute[74048]:       <nova:owner>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:user uuid="4a1b0e48155e4cb5b525d5366f59a963">tempest-AttachSCSIVolumeTestJSON-1025055638-project-member</nova:user>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:project uuid="6f3896af58054c3a9efa35f9502c8401">tempest-AttachSCSIVolumeTestJSON-1025055638</nova:project>
Oct 25 16:25:15 user nova-compute[74048]:       </nova:owner>
Oct 25 16:25:15 user nova-compute[74048]:       <nova:root type="image" uuid="6c645f1f-7a81-48fd-8107-7eeb60d46a52"/>
Oct 25 16:25:15 user nova-compute[74048]:       <nova:ports>
Oct 25 16:25:15 user nova-compute[74048]:         <nova:port uuid="c5649328-cbf9-459d-9a05-de071a78fc14">
Oct 25 16:25:15 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:25:15 user nova-compute[74048]:         </nova:port>
Oct 25 16:25:15 user nova-compute[74048]:       </nova:ports>
Oct 25 16:25:15 user nova-compute[74048]:     </nova:instance>
Oct 25 16:25:15 user nova-compute[74048]:   </metadata>
Oct 25 16:25:15 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:25:15 user nova-compute[74048]:     <system>
Oct 25 16:25:15 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:25:15 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:25:15 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:25:15 user nova-compute[74048]:       <entry name="serial">ddc67032-ea48-4809-9666-510c7f87f320</entry>
Oct 25 16:25:15 user nova-compute[74048]:       <entry name="uuid">ddc67032-ea48-4809-9666-510c7f87f320</entry>
Oct 25 16:25:15 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:25:15 user nova-compute[74048]:     </system>
Oct 25 16:25:15 user nova-compute[74048]:   </sysinfo>
Oct 25 16:25:15 user nova-compute[74048]:   <os>
Oct 25 16:25:15 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:25:15 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:25:15 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:25:15 user nova-compute[74048]:   </os>
Oct 25 16:25:15 user nova-compute[74048]:   <features>
Oct 25 16:25:15 user nova-compute[74048]:     <acpi/>
Oct 25 16:25:15 user nova-compute[74048]:     <apic/>
Oct 25 16:25:15 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:25:15 user nova-compute[74048]:   </features>
Oct 25 16:25:15 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:25:15 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:25:15 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:25:15 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:25:15 user nova-compute[74048]:   </clock>
Oct 25 16:25:15 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:25:15 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:25:15 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:25:15 user nova-compute[74048]:   </cpu>
Oct 25 16:25:15 user nova-compute[74048]:   <devices>
Oct 25 16:25:15 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:25:15 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:25:15 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk"/>
Oct 25 16:25:15 user nova-compute[74048]:       <target dev="sda" bus="scsi"/>
Oct 25 16:25:15 user nova-compute[74048]:       <address type="drive" controller="0" unit="0"/>
Oct 25 16:25:15 user nova-compute[74048]:     </disk>
Oct 25 16:25:15 user nova-compute[74048]:     <disk type="file" device="cdrom">
Oct 25 16:25:15 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 16:25:15 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.config"/>
Oct 25 16:25:15 user nova-compute[74048]:       <target dev="sdb" bus="scsi"/>
Oct 25 16:25:15 user nova-compute[74048]:       <address type="drive" controller="0" unit="1"/>
Oct 25 16:25:15 user nova-compute[74048]:     </disk>
Oct 25 16:25:15 user nova-compute[74048]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 25 16:25:15 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:25:15 user nova-compute[74048]:       <mac address="fa:16:3e:cc:0e:d6"/>
Oct 25 16:25:15 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:15 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:25:15 user nova-compute[74048]:       <target dev="tapc5649328-cb"/>
Oct 25 16:25:15 user nova-compute[74048]:     </interface>
Oct 25 16:25:15 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:25:15 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/console.log" append="off"/>
Oct 25 16:25:15 user nova-compute[74048]:     </serial>
Oct 25 16:25:15 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:25:15 user nova-compute[74048]:     <video>
Oct 25 16:25:15 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:15 user nova-compute[74048]:     </video>
Oct 25 16:25:15 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:25:15 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:25:15 user nova-compute[74048]:     </rng>
Oct 25 16:25:15 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:25:15 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:25:15 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:25:15 user nova-compute[74048]:     </memballoon>
Oct 25 16:25:15 user nova-compute[74048]:   </devices>
Oct 25 16:25:15 user nova-compute[74048]: </domain>
Oct 25 16:25:15 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1200770277',display_name='tempest-AttachSCSIVolumeTestJSON-server-1200770277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1200770277',id=7,image_ref='6c645f1f-7a81-48fd-8107-7eeb60d46a52',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbuxxpsUbCtmo9fboY8JrJ6ox1mlp6Z899bPyn7rDWqnkZ8npgWTcfI/tx3zGEIS+pWBl3bWKjkcwIPMNhoUt5+ZL1zaFA3Odw2INn42elHVYsl51Nrj9iKGwKPd+qfWA==',key_name='tempest-keypair-9011675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f3896af58054c3a9efa35f9502c8401',ramdisk_id='',reservation_id='r-wtwo19ms',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c645f1f-7a81-48fd-8107-7eeb60d46a52',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1025055638',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1025055638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1b0e48155e4cb5b525d5366f59a963',uuid=ddc67032-ea48-4809-9666-510c7f87f320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Converting VIF {"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG os_vif [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7badc53c-4d02-5665-bfaf-dfe4be1ea094', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-31e1013d-3e1b-4934-a3cd-2740b3d21bde tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.242s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5649328-cb, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5649328-cb, col_values=(('qos', UUID('e2c28da8-3c2f-4fc4-870d-9784f1aa8ae2')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5649328-cb, col_values=(('external_ids', {'iface-id': 'c5649328-cbf9-459d-9a05-de071a78fc14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:0e:d6', 'vm-uuid': 'ddc67032-ea48-4809-9666-510c7f87f320'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:15 user nova-compute[74048]: INFO os_vif [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb')
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No BDM found with device name sda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No VIF found with MAC fa:16:3e:cc:0e:d6, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:25:15 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Using config drive
Oct 25 16:25:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Creating config drive at /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.config
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj4xkjztb {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj4xkjztb" returned: 0 in 0.068s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updated VIF entry in instance network info cache for port c5649328-cbf9-459d-9a05-de071a78fc14. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updating instance_info_cache with network_info: [{"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-f8542907-d6ee-4fdd-a3b9-fee4619dc08d req-680b6c39-06d3-45af-b30e-383a73517adb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f8542907-d6ee-4fdd-a3b9-fee4619dc08d req-680b6c39-06d3-45af-b30e-383a73517adb service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f8542907-d6ee-4fdd-a3b9-fee4619dc08d req-680b6c39-06d3-45af-b30e-383a73517adb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f8542907-d6ee-4fdd-a3b9-fee4619dc08d req-680b6c39-06d3-45af-b30e-383a73517adb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-f8542907-d6ee-4fdd-a3b9-fee4619dc08d req-680b6c39-06d3-45af-b30e-383a73517adb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:16 user nova-compute[74048]: WARNING nova.compute.manager [req-f8542907-d6ee-4fdd-a3b9-fee4619dc08d req-680b6c39-06d3-45af-b30e-383a73517adb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state active and task_state None.
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c087bdff-10b6-4b08-ba9c-bd6b57e0b278 req-96b224a8-59ce-4a41-b0fb-d68b814b72f0 service nova] Releasing lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Successfully updated port: f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquired lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-changed-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Refreshing instance network info cache due to event network-changed-f5b2bbce-032c-4680-9643-6ee17f25816e. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] Acquiring lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:16 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updating instance_info_cache with network_info: [{"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Releasing lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Instance network_info: |[{"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] Acquired lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.neutron [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Refreshing network info cache for port f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Start _get_guest_xml network_info=[{"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:25:17 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:17 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1712251345',display_name='tempest-TestVolumeSwap-server-1712251345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1712251345',id=8,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXQlZGjrW/f34uOrSiiBeZ0doFTQi2ynS+Mwbfd5t8xJ12gCz+0D7mHdNpffSD/rxApumjqU6E3d7hl4QyRiTjyGSo4rPY71Ep8UtWQxHiutt3RRg0NMNwfgFfMsR0yBQ==',key_name='tempest-keypair-529919492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c5b6a583ea94bf18bb0100d3f49b9c2',ramdisk_id='',reservation_id='r-tutun10k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-205005956',owner_user_name='tempest-TestVolumeSwap-205005956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2248c3eb174326a6d08330d16835ea',uuid=4ae1fcb2-fa7f-44f5-8661-1271668567bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Converting VIF {"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:25:17 user nova-compute[74048]:   <uuid>4ae1fcb2-fa7f-44f5-8661-1271668567bd</uuid>
Oct 25 16:25:17 user nova-compute[74048]:   <name>instance-00000008</name>
Oct 25 16:25:17 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:25:17 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:25:17 user nova-compute[74048]:   <metadata>
Oct 25 16:25:17 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:25:17 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:25:17 user nova-compute[74048]:       <nova:name>tempest-TestVolumeSwap-server-1712251345</nova:name>
Oct 25 16:25:17 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:25:17</nova:creationTime>
Oct 25 16:25:17 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:25:17 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:25:17 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:25:17 user nova-compute[74048]:       <nova:owner>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:user uuid="db2248c3eb174326a6d08330d16835ea">tempest-TestVolumeSwap-205005956-project-member</nova:user>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:project uuid="9c5b6a583ea94bf18bb0100d3f49b9c2">tempest-TestVolumeSwap-205005956</nova:project>
Oct 25 16:25:17 user nova-compute[74048]:       </nova:owner>
Oct 25 16:25:17 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:25:17 user nova-compute[74048]:       <nova:ports>
Oct 25 16:25:17 user nova-compute[74048]:         <nova:port uuid="f5b2bbce-032c-4680-9643-6ee17f25816e">
Oct 25 16:25:17 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:25:17 user nova-compute[74048]:         </nova:port>
Oct 25 16:25:17 user nova-compute[74048]:       </nova:ports>
Oct 25 16:25:17 user nova-compute[74048]:     </nova:instance>
Oct 25 16:25:17 user nova-compute[74048]:   </metadata>
Oct 25 16:25:17 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:25:17 user nova-compute[74048]:     <system>
Oct 25 16:25:17 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:25:17 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:25:17 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:25:17 user nova-compute[74048]:       <entry name="serial">4ae1fcb2-fa7f-44f5-8661-1271668567bd</entry>
Oct 25 16:25:17 user nova-compute[74048]:       <entry name="uuid">4ae1fcb2-fa7f-44f5-8661-1271668567bd</entry>
Oct 25 16:25:17 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:25:17 user nova-compute[74048]:     </system>
Oct 25 16:25:17 user nova-compute[74048]:   </sysinfo>
Oct 25 16:25:17 user nova-compute[74048]:   <os>
Oct 25 16:25:17 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:25:17 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:25:17 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:25:17 user nova-compute[74048]:   </os>
Oct 25 16:25:17 user nova-compute[74048]:   <features>
Oct 25 16:25:17 user nova-compute[74048]:     <acpi/>
Oct 25 16:25:17 user nova-compute[74048]:     <apic/>
Oct 25 16:25:17 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:25:17 user nova-compute[74048]:   </features>
Oct 25 16:25:17 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:25:17 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:25:17 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:25:17 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:25:17 user nova-compute[74048]:   </clock>
Oct 25 16:25:17 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:25:17 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:25:17 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:25:17 user nova-compute[74048]:   </cpu>
Oct 25 16:25:17 user nova-compute[74048]:   <devices>
Oct 25 16:25:17 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:25:17 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:25:17 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk"/>
Oct 25 16:25:17 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:25:17 user nova-compute[74048]:     </disk>
Oct 25 16:25:17 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:25:17 user nova-compute[74048]:       <mac address="fa:16:3e:b9:3a:9c"/>
Oct 25 16:25:17 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:17 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:25:17 user nova-compute[74048]:       <target dev="tapf5b2bbce-03"/>
Oct 25 16:25:17 user nova-compute[74048]:     </interface>
Oct 25 16:25:17 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:25:17 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/console.log" append="off"/>
Oct 25 16:25:17 user nova-compute[74048]:     </serial>
Oct 25 16:25:17 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:25:17 user nova-compute[74048]:     <video>
Oct 25 16:25:17 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:17 user nova-compute[74048]:     </video>
Oct 25 16:25:17 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:25:17 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:25:17 user nova-compute[74048]:     </rng>
Oct 25 16:25:17 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:25:17 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:25:17 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:25:17 user nova-compute[74048]:     </memballoon>
Oct 25 16:25:17 user nova-compute[74048]:   </devices>
Oct 25 16:25:17 user nova-compute[74048]: </domain>
Oct 25 16:25:17 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1712251345',display_name='tempest-TestVolumeSwap-server-1712251345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1712251345',id=8,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXQlZGjrW/f34uOrSiiBeZ0doFTQi2ynS+Mwbfd5t8xJ12gCz+0D7mHdNpffSD/rxApumjqU6E3d7hl4QyRiTjyGSo4rPY71Ep8UtWQxHiutt3RRg0NMNwfgFfMsR0yBQ==',key_name='tempest-keypair-529919492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c5b6a583ea94bf18bb0100d3f49b9c2',ramdisk_id='',reservation_id='r-tutun10k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-205005956',owner_user_name='tempest-TestVolumeSwap-205005956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2248c3eb174326a6d08330d16835ea',uuid=4ae1fcb2-fa7f-44f5-8661-1271668567bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Converting VIF {"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG os_vif [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42d99ece-d26d-5b04-8c23-6d99ae3e1044', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5b2bbce-03, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5b2bbce-03, col_values=(('qos', UUID('c05ebc27-be3c-462e-8a25-7c1c7337fd81')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5b2bbce-03, col_values=(('external_ids', {'iface-id': 'f5b2bbce-032c-4680-9643-6ee17f25816e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:3a:9c', 'vm-uuid': '4ae1fcb2-fa7f-44f5-8661-1271668567bd'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: INFO os_vif [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03')
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] No VIF found with MAC fa:16:3e:b9:3a:9c, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.neutron [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updated VIF entry in instance network info cache for port f5b2bbce-032c-4680-9643-6ee17f25816e. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG nova.network.neutron [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updating instance_info_cache with network_info: [{"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-47849c0d-4d98-4a30-9699-4f455a8d22e8 req-89c304e9-e18b-4501-b3d4-84bae48f19a5 service nova] Releasing lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-6e42b1fb-2934-41be-87ad-0bf706b134eb req-42d1e1c8-ea4d-4f2b-853f-7700e4cd061d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6e42b1fb-2934-41be-87ad-0bf706b134eb req-42d1e1c8-ea4d-4f2b-853f-7700e4cd061d service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6e42b1fb-2934-41be-87ad-0bf706b134eb req-42d1e1c8-ea4d-4f2b-853f-7700e4cd061d service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6e42b1fb-2934-41be-87ad-0bf706b134eb req-42d1e1c8-ea4d-4f2b-853f-7700e4cd061d service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-6e42b1fb-2934-41be-87ad-0bf706b134eb req-42d1e1c8-ea4d-4f2b-853f-7700e4cd061d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:18 user nova-compute[74048]: WARNING nova.compute.manager [req-6e42b1fb-2934-41be-87ad-0bf706b134eb req-42d1e1c8-ea4d-4f2b-853f-7700e4cd061d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state active and task_state None.
Oct 25 16:25:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] No waiting events found dispatching network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:20 user nova-compute[74048]: WARNING nova.compute.manager [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received unexpected event network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e for instance with vm_state building and task_state spawning.
Oct 25 16:25:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] No waiting events found dispatching network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:20 user nova-compute[74048]: WARNING nova.compute.manager [req-8c9c8759-59ba-4919-9afc-d763e156d1e7 req-636cfff3-ab86-4c13-9f5d-5858fe1af6a3 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received unexpected event network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e for instance with vm_state building and task_state spawning.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:25:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Instance spawned successfully.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:22 user nova-compute[74048]: INFO nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Took 10.64 seconds to spawn the instance on the hypervisor.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:25:22 user nova-compute[74048]: INFO nova.compute.manager [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Took 11.65 seconds to build instance.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4a7a4064-b711-43d6-841a-b63f275ecb9c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.790s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:25:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Instance spawned successfully.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:22 user nova-compute[74048]: INFO nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Took 8.91 seconds to spawn the instance on the hypervisor.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:25:22 user nova-compute[74048]: INFO nova.compute.manager [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Took 10.43 seconds to build instance.
Oct 25 16:25:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cac27110-1a67-42d2-ae7b-857fcf2b0ae5 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.598s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-59f02aca-564c-4f97-af29-4f982bac98bb req-ebd0002a-8fd4-461e-bb21-a3b92159cb4f service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59f02aca-564c-4f97-af29-4f982bac98bb req-ebd0002a-8fd4-461e-bb21-a3b92159cb4f service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59f02aca-564c-4f97-af29-4f982bac98bb req-ebd0002a-8fd4-461e-bb21-a3b92159cb4f service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59f02aca-564c-4f97-af29-4f982bac98bb req-ebd0002a-8fd4-461e-bb21-a3b92159cb4f service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-59f02aca-564c-4f97-af29-4f982bac98bb req-ebd0002a-8fd4-461e-bb21-a3b92159cb4f service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:25 user nova-compute[74048]: WARNING nova.compute.manager [req-59f02aca-564c-4f97-af29-4f982bac98bb req-ebd0002a-8fd4-461e-bb21-a3b92159cb4f service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef for instance with vm_state active and task_state None.
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:27 user nova-compute[74048]: WARNING nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef for instance with vm_state active and task_state None.
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] No waiting events found dispatching network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:27 user nova-compute[74048]: WARNING nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received unexpected event network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 for instance with vm_state active and task_state None.
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] No waiting events found dispatching network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:27 user nova-compute[74048]: WARNING nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received unexpected event network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 for instance with vm_state active and task_state None.
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] No waiting events found dispatching network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:27 user nova-compute[74048]: WARNING nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received unexpected event network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 for instance with vm_state active and task_state None.
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] No waiting events found dispatching network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:27 user nova-compute[74048]: WARNING nova.compute.manager [req-67559b51-6d5f-414e-b5e7-e6a448447329 req-fb422234-2d4c-4d9a-ba57-99f7242304a2 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received unexpected event network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 for instance with vm_state active and task_state None.
Oct 25 16:25:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:25:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "15012856-adde-4587-b34e-979a0441bbaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:25:28 user nova-compute[74048]: INFO nova.compute.claims [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Claim successful on node user
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.network.neutron [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:25:28 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:25:28 user nova-compute[74048]: DEBUG nova.policy [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fffbda38c6543b19f6ccc95bbacf9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f5cef700c34a0db5b5877632eac00d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Skipping network cache update for instance because it is Building. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:25:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Creating image(s)
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "/opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "/opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "/opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.274s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.272s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk 1073741824" returned: 0 in 0.060s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Successfully created port: afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.292s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Cannot resize image /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Ensure instance console log exists: /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Successfully updated port: afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquired lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-changed-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Refreshing instance network info cache due to event network-changed-afed3a24-7d29-47ed-91f8-58db79a2d4e9. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] Acquiring lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updating instance_info_cache with network_info: [{"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Releasing lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Instance network_info: |[{"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] Acquired lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.neutron [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Refreshing network info cache for port afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Start _get_guest_xml network_info=[{"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:25:31 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:31 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-551467228',display_name='tempest-VolumesAssistedSnapshotsTest-server-551467228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-551467228',id=9,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIa+4X6Rj9i3w3Unln0a35dVUOp4vaUqrtzRwMy3CPqsnqoKu8HA+JzPY90uptkQkrSzEpfPX4PalTOxqlO39ENCOGN4WRKmqhu1j3ES3Oncf+jC4HcoOwJaLVcWpZN7g==',key_name='tempest-keypair-1934088057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f5cef700c34a0db5b5877632eac00d',ramdisk_id='',reservation_id='r-hlpy1yuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1206811372',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1206811372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fffbda38c6543b19f6ccc95bbacf9b8',uuid=15012856-adde-4587-b34e-979a0441bbaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Converting VIF {"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.objects.instance [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lazy-loading 'pci_devices' on Instance uuid 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:25:31 user nova-compute[74048]:   <uuid>15012856-adde-4587-b34e-979a0441bbaf</uuid>
Oct 25 16:25:31 user nova-compute[74048]:   <name>instance-00000009</name>
Oct 25 16:25:31 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:25:31 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:25:31 user nova-compute[74048]:   <metadata>
Oct 25 16:25:31 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:25:31 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:25:31 user nova-compute[74048]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-551467228</nova:name>
Oct 25 16:25:31 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:25:31</nova:creationTime>
Oct 25 16:25:31 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:25:31 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:25:31 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:25:31 user nova-compute[74048]:       <nova:owner>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:user uuid="8fffbda38c6543b19f6ccc95bbacf9b8">tempest-VolumesAssistedSnapshotsTest-1206811372-project-member</nova:user>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:project uuid="67f5cef700c34a0db5b5877632eac00d">tempest-VolumesAssistedSnapshotsTest-1206811372</nova:project>
Oct 25 16:25:31 user nova-compute[74048]:       </nova:owner>
Oct 25 16:25:31 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:25:31 user nova-compute[74048]:       <nova:ports>
Oct 25 16:25:31 user nova-compute[74048]:         <nova:port uuid="afed3a24-7d29-47ed-91f8-58db79a2d4e9">
Oct 25 16:25:31 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 16:25:31 user nova-compute[74048]:         </nova:port>
Oct 25 16:25:31 user nova-compute[74048]:       </nova:ports>
Oct 25 16:25:31 user nova-compute[74048]:     </nova:instance>
Oct 25 16:25:31 user nova-compute[74048]:   </metadata>
Oct 25 16:25:31 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:25:31 user nova-compute[74048]:     <system>
Oct 25 16:25:31 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:25:31 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:25:31 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:25:31 user nova-compute[74048]:       <entry name="serial">15012856-adde-4587-b34e-979a0441bbaf</entry>
Oct 25 16:25:31 user nova-compute[74048]:       <entry name="uuid">15012856-adde-4587-b34e-979a0441bbaf</entry>
Oct 25 16:25:31 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:25:31 user nova-compute[74048]:     </system>
Oct 25 16:25:31 user nova-compute[74048]:   </sysinfo>
Oct 25 16:25:31 user nova-compute[74048]:   <os>
Oct 25 16:25:31 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:25:31 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:25:31 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:25:31 user nova-compute[74048]:   </os>
Oct 25 16:25:31 user nova-compute[74048]:   <features>
Oct 25 16:25:31 user nova-compute[74048]:     <acpi/>
Oct 25 16:25:31 user nova-compute[74048]:     <apic/>
Oct 25 16:25:31 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:25:31 user nova-compute[74048]:   </features>
Oct 25 16:25:31 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:25:31 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:25:31 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:25:31 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:25:31 user nova-compute[74048]:   </clock>
Oct 25 16:25:31 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:25:31 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:25:31 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:25:31 user nova-compute[74048]:   </cpu>
Oct 25 16:25:31 user nova-compute[74048]:   <devices>
Oct 25 16:25:31 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:25:31 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:25:31 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk"/>
Oct 25 16:25:31 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:25:31 user nova-compute[74048]:     </disk>
Oct 25 16:25:31 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:25:31 user nova-compute[74048]:       <mac address="fa:16:3e:ba:1b:10"/>
Oct 25 16:25:31 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:31 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:25:31 user nova-compute[74048]:       <target dev="tapafed3a24-7d"/>
Oct 25 16:25:31 user nova-compute[74048]:     </interface>
Oct 25 16:25:31 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:25:31 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/console.log" append="off"/>
Oct 25 16:25:31 user nova-compute[74048]:     </serial>
Oct 25 16:25:31 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:25:31 user nova-compute[74048]:     <video>
Oct 25 16:25:31 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:25:31 user nova-compute[74048]:     </video>
Oct 25 16:25:31 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:25:31 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:25:31 user nova-compute[74048]:     </rng>
Oct 25 16:25:31 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:25:31 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:25:31 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:25:31 user nova-compute[74048]:     </memballoon>
Oct 25 16:25:31 user nova-compute[74048]:   </devices>
Oct 25 16:25:31 user nova-compute[74048]: </domain>
Oct 25 16:25:31 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-551467228',display_name='tempest-VolumesAssistedSnapshotsTest-server-551467228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-551467228',id=9,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIa+4X6Rj9i3w3Unln0a35dVUOp4vaUqrtzRwMy3CPqsnqoKu8HA+JzPY90uptkQkrSzEpfPX4PalTOxqlO39ENCOGN4WRKmqhu1j3ES3Oncf+jC4HcoOwJaLVcWpZN7g==',key_name='tempest-keypair-1934088057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f5cef700c34a0db5b5877632eac00d',ramdisk_id='',reservation_id='r-hlpy1yuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1206811372',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1206811372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fffbda38c6543b19f6ccc95bbacf9b8',uuid=15012856-adde-4587-b34e-979a0441bbaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Converting VIF {"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG os_vif [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beb7a4aa-0309-520e-8ac4-adfae31cb6e9', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafed3a24-7d, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafed3a24-7d, col_values=(('qos', UUID('f047ff99-2daa-446f-bdc6-671d62cf4bb5')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafed3a24-7d, col_values=(('external_ids', {'iface-id': 'afed3a24-7d29-47ed-91f8-58db79a2d4e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:1b:10', 'vm-uuid': '15012856-adde-4587-b34e-979a0441bbaf'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:31 user nova-compute[74048]: INFO os_vif [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d')
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] No VIF found with MAC fa:16:3e:ba:1b:10, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.neutron [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updated VIF entry in instance network info cache for port afed3a24-7d29-47ed-91f8-58db79a2d4e9. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG nova.network.neutron [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updating instance_info_cache with network_info: [{"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-84b873f5-7cba-42dc-a4ca-2de34a2dc1ad req-983aa3e9-f4e4-4176-bcfe-bd8e2d78ce99 service nova] Releasing lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:31 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:32 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:32 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-7eb9f75a-5142-478b-a060-76809639b44e req-93c2da37-bcab-4955-9561-5e7bf95b992a service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7eb9f75a-5142-478b-a060-76809639b44e req-93c2da37-bcab-4955-9561-5e7bf95b992a service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7eb9f75a-5142-478b-a060-76809639b44e req-93c2da37-bcab-4955-9561-5e7bf95b992a service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7eb9f75a-5142-478b-a060-76809639b44e req-93c2da37-bcab-4955-9561-5e7bf95b992a service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-7eb9f75a-5142-478b-a060-76809639b44e req-93c2da37-bcab-4955-9561-5e7bf95b992a service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:33 user nova-compute[74048]: WARNING nova.compute.manager [req-7eb9f75a-5142-478b-a060-76809639b44e req-93c2da37-bcab-4955-9561-5e7bf95b992a service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state building and task_state spawning.
Oct 25 16:25:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:33 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-a5a1af01-5161-4542-ab79-a1bc5ce40fc9 req-f87d5f51-a884-4850-bbda-61270d0a308e service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a5a1af01-5161-4542-ab79-a1bc5ce40fc9 req-f87d5f51-a884-4850-bbda-61270d0a308e service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a5a1af01-5161-4542-ab79-a1bc5ce40fc9 req-f87d5f51-a884-4850-bbda-61270d0a308e service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a5a1af01-5161-4542-ab79-a1bc5ce40fc9 req-f87d5f51-a884-4850-bbda-61270d0a308e service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-a5a1af01-5161-4542-ab79-a1bc5ce40fc9 req-f87d5f51-a884-4850-bbda-61270d0a308e service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:25:35 user nova-compute[74048]: WARNING nova.compute.manager [req-a5a1af01-5161-4542-ab79-a1bc5ce40fc9 req-f87d5f51-a884-4850-bbda-61270d0a308e service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state building and task_state spawning.
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:25:35 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Instance spawned successfully.
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:25:35 user nova-compute[74048]: INFO nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Took 6.44 seconds to spawn the instance on the hypervisor.
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:25:35 user nova-compute[74048]: INFO nova.compute.manager [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Took 7.55 seconds to build instance.
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-09eb465f-8a16-4fb3-ba86-f8897e1d375d tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "15012856-adde-4587-b34e-979a0441bbaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.670s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:35 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:40 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:40 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:25:40 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7385MB free_disk=25.695640563964844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:25:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c363340c-e38a-4627-8ad5-d8a2a5cb11ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ddc67032-ea48-4809-9666-510c7f87f320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 15012856-adde-4587-b34e-979a0441bbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:25:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.008s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:25:54 user nova-compute[74048]: INFO nova.compute.claims [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Claim successful on node user
Oct 25 16:25:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:25:54 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:25:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:25:55 user nova-compute[74048]: DEBUG nova.policy [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0503e1c84bd641b48406fcf9dbdda397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1265f3be7364d58b49cca5d7b7be97a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:25:55 user nova-compute[74048]: INFO nova.virt.block_device [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Booting with volume 0f82c659-17b7-4d55-a2a5-ddc7172ba044 at /dev/vda
Oct 25 16:25:55 user nova-compute[74048]: DEBUG os_brick.utils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:25:55 user nova-compute[74048]: INFO oslo.privsep.daemon [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpg1bru205/privsep.sock']
Oct 25 16:25:55 user sudo[85398]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpg1bru205/privsep.sock
Oct 25 16:25:55 user sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 16:25:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Successfully created port: ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Successfully updated port: ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquired lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-changed-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Refreshing instance network info cache due to event network-changed-ebbda323-9a84-4f24-9a1c-6c3359340b69. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] Acquiring lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:25:56 user sudo[85398]: pam_unix(sudo:session): session closed for user root
Oct 25 16:25:56 user nova-compute[74048]: INFO oslo.privsep.daemon [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Spawned new privsep daemon via rootwrap
Oct 25 16:25:56 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 16:25:56 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 16:25:56 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 25 16:25:56 user nova-compute[74048]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85401
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updating instance_info_cache with network_info: [{"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2a1afc-beb1-4900-8b60-04ba41de0281]: (2,) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Releasing lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance network_info: |[{"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] Acquired lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Refreshing network info cache for port ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a6195f-d534-44c7-a423-6850bfee77e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:25:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.nvmeof [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc59a699-17e8-4348-9c9a-9c2ff166f68b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b913f7c3-fe7e-402b-a88a-c5314861972d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e951316-be19-447e-8bda-7df58e456266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:25:56 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:25:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a46be6-7301-4a83-9e55-a3cb424bfa51]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG os_brick.utils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== get_connector_properties: return (1800ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:25:56 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updating existing volume attachment record: bedb7bde-f3ca-4cca-8eb4-2051786fc04e {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:25:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updated VIF entry in instance network info cache for port ebbda323-9a84-4f24-9a1c-6c3359340b69. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:25:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updating instance_info_cache with network_info: [{"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:25:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b7f4a1de-c545-4c27-b9c6-6bf33f2d3d4e req-6059bb6f-a572-4024-b246-2b828af47d3b service nova] Releasing lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:25:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:26:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Creating image(s)
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Ensure instance console log exists: /opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Start _get_guest_xml network_info=[{"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'bedb7bde-f3ca-4cca-8eb4-2051786fc04e', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bdfc844-9046-4f08-b276-2eee1d5fc5c3', 'attached_at': '', 'detached_at': '', 'volume_id': '0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'serial': '0f82c659-17b7-4d55-a2a5-ddc7172ba044'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:26:14 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:26:14 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connector [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Factory for ISCSI on None {{(pid=74048) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:26:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:26:14 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e70a657-e445-4185-a9b1-c8aaf2c6a9fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:26:14 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[540d29d1-67a7-419b-90a9-1b571869d468]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044] added
Oct 25 16:26:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321eb38-44a8-4a9f-a60f-78e64253dd10]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[949782da-d819-4b03-9f56-576dfa1c6e66]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsEtyDxH {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsEtyDxH" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d301fa3-ff62-48e6-a4f4-eb284303eb65]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsEtyDxH'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d6798f-613e-49e0-8609-d170b42cb303]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aff702-a8ca-41e0-9e4f-d2385d0033f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:26:14 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:26:14 user nova-compute[74048]:  {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:26:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 16:26:14 user nova-compute[74048]: 
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93eff3a-907f-4069-9510-12290bc620d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]
Oct 25 16:26:14 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.
Oct 25 16:26:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d7944-6cfe-4397-8c34-5e793ba0eabf]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed3c61c-4a37-48e7-a034-aacc29f2a777]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d920451-3fb4-4231-a9ee-11e5c8bfca1f]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:26:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23762613363383265', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762613363383265', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-382712036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382712036',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjjojn8YvnWNnajLosTW7x1rEzFmEFfnM1fIXglgkUuo3CmTU0gSBineq0pi5f4jomsN5QQoXslmxH2A46axyunIDAhWEP2hpfFpWoacytfPoUYSAhxnWVokf1k7zVdXQ==',key_name='tempest-keypair-734782483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1265f3be7364d58b49cca5d7b7be97a',ramdisk_id='',reservation_id='r-tw4vdi7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-599396862',owner_user_name='tempest-ServerActionsV293TestJSON-599396862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0503e1c84bd641b48406fcf9dbdda397',uuid=1bdfc844-9046-4f08-b276-2eee1d5fc5c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converting VIF {"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:26:15 user nova-compute[74048]:   <uuid>1bdfc844-9046-4f08-b276-2eee1d5fc5c3</uuid>
Oct 25 16:26:15 user nova-compute[74048]:   <name>instance-0000000a</name>
Oct 25 16:26:15 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:26:15 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:26:15 user nova-compute[74048]:   <metadata>
Oct 25 16:26:15 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:26:15 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:26:15 user nova-compute[74048]:       <nova:name>tempest-ServerActionsV293TestJSON-server-382712036</nova:name>
Oct 25 16:26:15 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:26:14</nova:creationTime>
Oct 25 16:26:15 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:26:15 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:26:15 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:26:15 user nova-compute[74048]:       <nova:owner>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:user uuid="0503e1c84bd641b48406fcf9dbdda397">tempest-ServerActionsV293TestJSON-599396862-project-member</nova:user>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:project uuid="f1265f3be7364d58b49cca5d7b7be97a">tempest-ServerActionsV293TestJSON-599396862</nova:project>
Oct 25 16:26:15 user nova-compute[74048]:       </nova:owner>
Oct 25 16:26:15 user nova-compute[74048]:       <nova:ports>
Oct 25 16:26:15 user nova-compute[74048]:         <nova:port uuid="ebbda323-9a84-4f24-9a1c-6c3359340b69">
Oct 25 16:26:15 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 16:26:15 user nova-compute[74048]:         </nova:port>
Oct 25 16:26:15 user nova-compute[74048]:       </nova:ports>
Oct 25 16:26:15 user nova-compute[74048]:     </nova:instance>
Oct 25 16:26:15 user nova-compute[74048]:   </metadata>
Oct 25 16:26:15 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:26:15 user nova-compute[74048]:     <system>
Oct 25 16:26:15 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:26:15 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:26:15 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:26:15 user nova-compute[74048]:       <entry name="serial">1bdfc844-9046-4f08-b276-2eee1d5fc5c3</entry>
Oct 25 16:26:15 user nova-compute[74048]:       <entry name="uuid">1bdfc844-9046-4f08-b276-2eee1d5fc5c3</entry>
Oct 25 16:26:15 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:26:15 user nova-compute[74048]:     </system>
Oct 25 16:26:15 user nova-compute[74048]:   </sysinfo>
Oct 25 16:26:15 user nova-compute[74048]:   <os>
Oct 25 16:26:15 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:26:15 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:26:15 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:26:15 user nova-compute[74048]:   </os>
Oct 25 16:26:15 user nova-compute[74048]:   <features>
Oct 25 16:26:15 user nova-compute[74048]:     <acpi/>
Oct 25 16:26:15 user nova-compute[74048]:     <apic/>
Oct 25 16:26:15 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:26:15 user nova-compute[74048]:   </features>
Oct 25 16:26:15 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:26:15 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:26:15 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:26:15 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:26:15 user nova-compute[74048]:   </clock>
Oct 25 16:26:15 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:26:15 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:26:15 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:26:15 user nova-compute[74048]:   </cpu>
Oct 25 16:26:15 user nova-compute[74048]:   <devices>
Oct 25 16:26:15 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:26:15 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:26:15 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:26:15 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:26:15 user nova-compute[74048]:       <serial>0f82c659-17b7-4d55-a2a5-ddc7172ba044</serial>
Oct 25 16:26:15 user nova-compute[74048]:     </disk>
Oct 25 16:26:15 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:26:15 user nova-compute[74048]:       <mac address="fa:16:3e:72:41:7c"/>
Oct 25 16:26:15 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:26:15 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:26:15 user nova-compute[74048]:       <target dev="tapebbda323-9a"/>
Oct 25 16:26:15 user nova-compute[74048]:     </interface>
Oct 25 16:26:15 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:26:15 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3/console.log" append="off"/>
Oct 25 16:26:15 user nova-compute[74048]:     </serial>
Oct 25 16:26:15 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:26:15 user nova-compute[74048]:     <video>
Oct 25 16:26:15 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:26:15 user nova-compute[74048]:     </video>
Oct 25 16:26:15 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:26:15 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:26:15 user nova-compute[74048]:     </rng>
Oct 25 16:26:15 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:26:15 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:26:15 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:26:15 user nova-compute[74048]:     </memballoon>
Oct 25 16:26:15 user nova-compute[74048]:   </devices>
Oct 25 16:26:15 user nova-compute[74048]: </domain>
Oct 25 16:26:15 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-382712036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382712036',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjjojn8YvnWNnajLosTW7x1rEzFmEFfnM1fIXglgkUuo3CmTU0gSBineq0pi5f4jomsN5QQoXslmxH2A46axyunIDAhWEP2hpfFpWoacytfPoUYSAhxnWVokf1k7zVdXQ==',key_name='tempest-keypair-734782483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1265f3be7364d58b49cca5d7b7be97a',ramdisk_id='',reservation_id='r-tw4vdi7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-599396862',owner_user_name='tempest-ServerActionsV293TestJSON-599396862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:25:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0503e1c84bd641b48406fcf9dbdda397',uuid=1bdfc844-9046-4f08-b276-2eee1d5fc5c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converting VIF {"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG os_vif [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fc670f4-27df-5abb-a37a-83a813bc6ac4', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebbda323-9a, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebbda323-9a, col_values=(('qos', UUID('dc842b82-666d-4a4c-99f0-d8cf7ac8a7df')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebbda323-9a, col_values=(('external_ids', {'iface-id': 'ebbda323-9a84-4f24-9a1c-6c3359340b69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:41:7c', 'vm-uuid': '1bdfc844-9046-4f08-b276-2eee1d5fc5c3'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:16 user nova-compute[74048]: INFO os_vif [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a')
Oct 25 16:26:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] No VIF found with MAC fa:16:3e:72:41:7c, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa13bdf5-bbab-441e-b16f-c82659ab0f55 req-acc7a8a3-e2ec-4fc1-8c57-ddf6a53ab359 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa13bdf5-bbab-441e-b16f-c82659ab0f55 req-acc7a8a3-e2ec-4fc1-8c57-ddf6a53ab359 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa13bdf5-bbab-441e-b16f-c82659ab0f55 req-acc7a8a3-e2ec-4fc1-8c57-ddf6a53ab359 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa13bdf5-bbab-441e-b16f-c82659ab0f55 req-acc7a8a3-e2ec-4fc1-8c57-ddf6a53ab359 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa13bdf5-bbab-441e-b16f-c82659ab0f55 req-acc7a8a3-e2ec-4fc1-8c57-ddf6a53ab359 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:17 user nova-compute[74048]: WARNING nova.compute.manager [req-fa13bdf5-bbab-441e-b16f-c82659ab0f55 req-acc7a8a3-e2ec-4fc1-8c57-ddf6a53ab359 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state building and task_state spawning.
Oct 25 16:26:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:26:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance spawned successfully.
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-44c92f7e-25f5-4944-a69f-c70ea7f20005 req-12d2144c-5910-4993-88d7-f9c436d92256 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44c92f7e-25f5-4944-a69f-c70ea7f20005 req-12d2144c-5910-4993-88d7-f9c436d92256 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44c92f7e-25f5-4944-a69f-c70ea7f20005 req-12d2144c-5910-4993-88d7-f9c436d92256 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44c92f7e-25f5-4944-a69f-c70ea7f20005 req-12d2144c-5910-4993-88d7-f9c436d92256 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-44c92f7e-25f5-4944-a69f-c70ea7f20005 req-12d2144c-5910-4993-88d7-f9c436d92256 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:19 user nova-compute[74048]: WARNING nova.compute.manager [req-44c92f7e-25f5-4944-a69f-c70ea7f20005 req-12d2144c-5910-4993-88d7-f9c436d92256 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state building and task_state spawning.
Oct 25 16:26:19 user nova-compute[74048]: INFO nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Took 5.18 seconds to spawn the instance on the hypervisor.
Oct 25 16:26:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:26:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:19 user nova-compute[74048]: INFO nova.compute.manager [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Took 25.44 seconds to build instance.
Oct 25 16:26:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1758c43e-3d1a-482c-b38b-ac776d7dbf2a tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.562s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:24 user nova-compute[74048]: INFO nova.compute.manager [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Rescuing
Oct 25 16:26:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:24 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:26:25 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-7188a472-d6c2-43a3-9e36-98cfc5ac23d2 req-e50a47ed-124d-4a8a-ac4a-40da4b70c1f9 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-unplugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7188a472-d6c2-43a3-9e36-98cfc5ac23d2 req-e50a47ed-124d-4a8a-ac4a-40da4b70c1f9 service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7188a472-d6c2-43a3-9e36-98cfc5ac23d2 req-e50a47ed-124d-4a8a-ac4a-40da4b70c1f9 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7188a472-d6c2-43a3-9e36-98cfc5ac23d2 req-e50a47ed-124d-4a8a-ac4a-40da4b70c1f9 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-7188a472-d6c2-43a3-9e36-98cfc5ac23d2 req-e50a47ed-124d-4a8a-ac4a-40da4b70c1f9 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-unplugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:26 user nova-compute[74048]: WARNING nova.compute.manager [req-7188a472-d6c2-43a3-9e36-98cfc5ac23d2 req-e50a47ed-124d-4a8a-ac4a-40da4b70c1f9 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-unplugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state active and task_state rescuing.
Oct 25 16:26:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance destroyed successfully.
Oct 25 16:26:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Attempting rescue
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74048) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:26:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Creating image(s)
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue" returned: 0 in 0.060s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'migration_context' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.base [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<51f3e782-7fc1-4de3-9d74-1d29f3ef9054> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Start _get_guest_xml network_info=[{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:70:14:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'resources' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.base [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<51f3e782-7fc1-4de3-9d74-1d29f3ef9054> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'numa_topology' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.base [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<51f3e782-7fc1-4de3-9d74-1d29f3ef9054> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:26:26 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:26:26 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.base [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<51f3e782-7fc1-4de3-9d74-1d29f3ef9054> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1245678211',display_name='tempest-ServerRescueNegativeTestJSON-server-1245678211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1245678211',id=2,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-7uvu50qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:52Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=51f3e782-7fc1-4de3-9d74-1d29f3ef9054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:70:14:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:70:14:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'pci_devices' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.objects.base [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<51f3e782-7fc1-4de3-9d74-1d29f3ef9054> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:26:26 user nova-compute[74048]:   <uuid>51f3e782-7fc1-4de3-9d74-1d29f3ef9054</uuid>
Oct 25 16:26:26 user nova-compute[74048]:   <name>instance-00000002</name>
Oct 25 16:26:26 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:26:26 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:26:26 user nova-compute[74048]:   <metadata>
Oct 25 16:26:26 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:26:26 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:26:26 user nova-compute[74048]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1245678211</nova:name>
Oct 25 16:26:26 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:26:26</nova:creationTime>
Oct 25 16:26:26 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:26:26 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:26:26 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:26:26 user nova-compute[74048]:       <nova:owner>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:user uuid="94ff1b26939b49ba88fe0105bec65fc2">tempest-ServerRescueNegativeTestJSON-1121503960-project-member</nova:user>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:project uuid="931f649d6b844bbdaec9f1b97ab1112c">tempest-ServerRescueNegativeTestJSON-1121503960</nova:project>
Oct 25 16:26:26 user nova-compute[74048]:       </nova:owner>
Oct 25 16:26:26 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:26:26 user nova-compute[74048]:       <nova:ports>
Oct 25 16:26:26 user nova-compute[74048]:         <nova:port uuid="d42debd6-9c21-464b-84ed-1207ba8480bb">
Oct 25 16:26:26 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 16:26:26 user nova-compute[74048]:         </nova:port>
Oct 25 16:26:26 user nova-compute[74048]:       </nova:ports>
Oct 25 16:26:26 user nova-compute[74048]:     </nova:instance>
Oct 25 16:26:26 user nova-compute[74048]:   </metadata>
Oct 25 16:26:26 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:26:26 user nova-compute[74048]:     <system>
Oct 25 16:26:26 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:26:26 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:26:26 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:26:26 user nova-compute[74048]:       <entry name="serial">51f3e782-7fc1-4de3-9d74-1d29f3ef9054</entry>
Oct 25 16:26:26 user nova-compute[74048]:       <entry name="uuid">51f3e782-7fc1-4de3-9d74-1d29f3ef9054</entry>
Oct 25 16:26:26 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:26:26 user nova-compute[74048]:     </system>
Oct 25 16:26:26 user nova-compute[74048]:   </sysinfo>
Oct 25 16:26:26 user nova-compute[74048]:   <os>
Oct 25 16:26:26 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:26:26 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:26:26 user nova-compute[74048]:   </os>
Oct 25 16:26:26 user nova-compute[74048]:   <features>
Oct 25 16:26:26 user nova-compute[74048]:     <acpi/>
Oct 25 16:26:26 user nova-compute[74048]:     <apic/>
Oct 25 16:26:26 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:26:26 user nova-compute[74048]:   </features>
Oct 25 16:26:26 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:26:26 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:26:26 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:26:26 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:26:26 user nova-compute[74048]:   </clock>
Oct 25 16:26:26 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:26:26 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:26:26 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:26:26 user nova-compute[74048]:   </cpu>
Oct 25 16:26:26 user nova-compute[74048]:   <devices>
Oct 25 16:26:26 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:26:26 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:26:26 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue"/>
Oct 25 16:26:26 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:26:26 user nova-compute[74048]:     </disk>
Oct 25 16:26:26 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:26:26 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:26:26 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk"/>
Oct 25 16:26:26 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:26:26 user nova-compute[74048]:     </disk>
Oct 25 16:26:26 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:26:26 user nova-compute[74048]:       <mac address="fa:16:3e:70:14:eb"/>
Oct 25 16:26:26 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:26:26 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:26:26 user nova-compute[74048]:       <target dev="tapd42debd6-9c"/>
Oct 25 16:26:26 user nova-compute[74048]:     </interface>
Oct 25 16:26:26 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:26:26 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/console.log" append="off"/>
Oct 25 16:26:26 user nova-compute[74048]:     </serial>
Oct 25 16:26:26 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:26:26 user nova-compute[74048]:     <video>
Oct 25 16:26:26 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:26:26 user nova-compute[74048]:     </video>
Oct 25 16:26:26 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:26:26 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:26:26 user nova-compute[74048]:     </rng>
Oct 25 16:26:26 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:26:26 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:26:26 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:26:26 user nova-compute[74048]:     </memballoon>
Oct 25 16:26:26 user nova-compute[74048]:   </devices>
Oct 25 16:26:26 user nova-compute[74048]: </domain>
Oct 25 16:26:26 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:26:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance destroyed successfully.
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:70:14:eb, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-5db19056-f7b8-4f5f-a82b-9e31a9fbb36c req-31164a07-e2ac-4158-81fd-bdcdb14c8a57 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5db19056-f7b8-4f5f-a82b-9e31a9fbb36c req-31164a07-e2ac-4158-81fd-bdcdb14c8a57 service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5db19056-f7b8-4f5f-a82b-9e31a9fbb36c req-31164a07-e2ac-4158-81fd-bdcdb14c8a57 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5db19056-f7b8-4f5f-a82b-9e31a9fbb36c req-31164a07-e2ac-4158-81fd-bdcdb14c8a57 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-5db19056-f7b8-4f5f-a82b-9e31a9fbb36c req-31164a07-e2ac-4158-81fd-bdcdb14c8a57 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:28 user nova-compute[74048]: WARNING nova.compute.manager [req-5db19056-f7b8-4f5f-a82b-9e31a9fbb36c req-31164a07-e2ac-4158-81fd-bdcdb14c8a57 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state active and task_state rescuing.
Oct 25 16:26:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:26:29 user nova-compute[74048]: INFO nova.compute.claims [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Claim successful on node user
Oct 25 16:26:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:26:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:26:30 user nova-compute[74048]: INFO nova.virt.block_device [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Booting with volume 43b1a248-a4da-4e54-8a17-812e5c148286 at /dev/vda
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:30 user nova-compute[74048]: WARNING nova.compute.manager [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state active and task_state rescuing.
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:30 user nova-compute[74048]: WARNING nova.compute.manager [req-d80e3a23-90ed-4994-845f-2a4e84460e1e req-39035d0b-61f0-4062-b6c6-3071e0c6493d service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state active and task_state rescuing.
Oct 25 16:26:30 user nova-compute[74048]: DEBUG os_brick.utils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.policy [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70a32b6dc0a247408bdcbd2c9f5e6fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aedadab87724e0c9a581890f0cccb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d820d41c-b107-4cc8-af20-465690be6704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd130ac-ce4c-4a04-a9ef-b707aee9732f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad75205-5801-4d50-ace7-3f0b4f5509b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d111636-abdf-4d8e-af71-28c99725c8dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:30 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:26:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda2436-bd71-43b1-a6c6-7fb74de03a2b]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG os_brick.utils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating existing volume attachment record: 117e6aa5-2a65-48a6-8ee4-5b08222bdc9e {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:26:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fe4a86a7-b715-4a78-b796-aa29998b9433 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:26:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully created port: 16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:26:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully created port: e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:26:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully created port: 321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:26:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lazy-loading 'flavor' on Instance uuid c363340c-e38a-4627-8ad5-d8a2a5cb11ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:33 user nova-compute[74048]: INFO nova.compute.manager [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Attaching volume ace72e6a-82d7-43df-b769-9bd1451987e4 to /dev/vdb
Oct 25 16:26:33 user nova-compute[74048]: DEBUG os_brick.utils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c679f21b-6935-4c6b-ae4b-e1b1bf76fcb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e997d921-aeee-4761-8536-232cbba4c92d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8e3254-9438-4ea4-bd93-f2a173953783]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa9db3-c1f3-4524-9e65-1bef6b8f0033]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:33 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:26:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e98f1-3c03-4ada-829e-426336b5dd1a]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG os_brick.utils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Updating existing volume attachment record: bc475220-a525-4afb-be6f-2bad917e5807 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully created port: 02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:26:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully created port: 2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:26:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: 16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-16da64ac-473b-4a8a-9e0d-de230daee02f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:35 user nova-compute[74048]: DEBUG nova.network.neutron [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da84ce72-30d2-42c5-a249-046c511d59e5 req-719557cb-d877-4c9a-940c-71b9aad604fb service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:36 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: 4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:26:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: 1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-changed-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Refreshing instance network info cache due to event network-changed-cba57bbe-a7a5-4d0f-981d-66bcd9d81974. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Refreshing network info cache for port cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated VIF entry in instance network info cache for port cba57bbe-a7a5-4d0f-981d-66bcd9d81974. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-4845e63d-9ded-4e12-9329-8c34f48cf3aa. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.network.neutron [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e17a2213-e3a7-479f-aa86-9b8db75c58ba req-4b55a830-7e75-4c42-b057-b4400fffff48 service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.network.neutron [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.network.neutron [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: 321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG nova.network.neutron [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e200c8b1-ca09-49fc-a500-46b2323e63f1 req-e19fd503-d8fd-4941-b11e-c69597b29f87 service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: 02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Successfully updated port: 2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-321e2058-c668-430f-8bbd-cd654b7ed753. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:26:42 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:26:42 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:26:42 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7101MB free_disk=25.624034881591797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c363340c-e38a-4627-8ad5-d8a2a5cb11ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ddc67032-ea48-4809-9666-510c7f87f320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 15012856-adde-4587-b34e-979a0441bbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 62102eec-d6bd-45d2-a45e-bd90278a34a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:26:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance network_info: |[{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:26:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updated VIF entry in instance network info cache for port 321e2058-c668-430f-8bbd-cd654b7ed753. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-02e9da4d-a459-499a-9cc6-2b46f90a7e5d. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updated VIF entry in instance network info cache for port 02e9da4d-a459-499a-9cc6-2b46f90a7e5d. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-2a302c98-fde0-490f-8ac9-7cd487954e70. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:46 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updated VIF entry in instance network info cache for port 2a302c98-fde0-490f-8ac9-7cd487954e70. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:46 user nova-compute[74048]: DEBUG nova.network.neutron [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4ad20b91-6d77-4147-b1fe-eaa874f20f02 req-57f8ae3c-71fd-4958-a49e-d50b12da7179 service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-changed-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Refreshing instance network info cache due to event network-changed-0334d634-48ac-4890-a7cc-a85599ae2cef. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Refreshing network info cache for port 0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "interface-25e59513-b3bb-44c2-ac27-f9dcdacffed1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "interface-25e59513-b3bb-44c2-ac27-f9dcdacffed1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'flavor' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DjGFJTio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:54 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:26:54 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:26:54 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updated VIF entry in instance network info cache for port 0334d634-48ac-4890-a7cc-a85599ae2cef. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8b8e96-03f6-4170-8704-dc7037c431a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:26:54 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-afed2465-432d-4ab6-b61f-f25733e28d46 req-61f18cae-03b4-41e6-8e24-7f499c1625c5 service nova] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a077381-baa9-44ab-bba5-9f02c8e0669c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4] added
Oct 25 16:26:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e4081-e5cf-4856-af5b-50cf9ff70a4c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'pci_requests' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.objects.base [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Object Instance<25e59513-b3bb-44c2-ac27-f9dcdacffed1> lazy-loaded attributes: flavor,pci_requests {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bcde0c-2591-4835-9b4c-9b51b03415fc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DjGFJTio {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DjGFJTio" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[817aa7f8-991d-4b55-a717-d399905ddafd]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DjGFJTio'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[149f6297-7d78-4014-8f02-7fdf106bbb35]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce88be-0bfc-4434-aef9-7ee2f4239644]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG nova.policy [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d9a5ea3d09a4616b439473e03ec3bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da4a9d7ce314c309771155151f1841d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd85000-9353-482a-b2fe-3a09f8ad1a9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260]
Oct 25 16:26:54 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260] successful.
Oct 25 16:26:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79418aa-5445-4d4f-86fd-5ad9e75c5dd2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7e37ea-f10d-46f4-8e67-94acfbf897aa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:54 user nova-compute[74048]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 (non-flash)
Oct 25 16:26:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:54 user nova-compute[74048]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 (non-flash)
Oct 25 16:26:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e250a2-8f39-4425-b56c-7afc3cf365fe]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DjGFJTio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:26:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Successfully created port: a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:26:55 user nova-compute[74048]: INFO nova.virt.block_device [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Booting with volume 18ab6feb-5c15-432c-8da9-4b123856f9ea at /dev/vdb
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.utils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59488ce-2d19-4119-84ed-6fb62d88b49e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7726114-4557-4b99-9d94-73c676c054d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da02e0-965b-43b9-ad5f-b5c97237d89f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7748f-1833-4fde-942f-8793f45caab9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:55 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0948ab-ce3b-4714-9fe5-4d7ebd5f1d3f]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.utils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating existing volume attachment record: 060dd66d-1fe4-44b8-a33d-fc6ab781398a {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26532326435613333', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532326435613333', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-changed-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Refreshing instance network info cache due to event network-changed-9b11a8e3-fd0d-48a8-b258-e6b7db930f11. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] Acquiring lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] Acquired lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.network.neutron [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Refreshing network info cache for port 9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.objects.instance [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lazy-loading 'flavor' on Instance uuid c363340c-e38a-4627-8ad5-d8a2a5cb11ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:26:55 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:26:55 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:26:55 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:26:55 user nova-compute[74048]:   <serial>ace72e6a-82d7-43df-b769-9bd1451987e4</serial>
Oct 25 16:26:55 user nova-compute[74048]: </disk>
Oct 25 16:26:55 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Successfully updated port: a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-changed-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Refreshing instance network info cache due to event network-changed-a03d1557-3c0c-4b3d-922e-e62c83fadcd3. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] No VIF found with MAC fa:16:3e:be:ec:71, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updated VIF entry in instance network info cache for port 9b11a8e3-fd0d-48a8-b258-e6b7db930f11. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updating instance_info_cache with network_info: [{"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ecd4aaed-f876-4fab-8504-421154848be7 req-06ef94d1-9c51-449d-a8bf-06267764370a service nova] Releasing lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b3bb64-99a4-49df-aaeb-9287097adede tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.148s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Refreshing network info cache for port a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG os_vif [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32b42bac-7fdd-5715-8246-caaaaf8ffd8b', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa03d1557-3c, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa03d1557-3c, col_values=(('qos', UUID('63a540b7-cf2a-4447-93b7-6664c6ef33a7')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa03d1557-3c, col_values=(('external_ids', {'iface-id': 'a03d1557-3c0c-4b3d-922e-e62c83fadcd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:a0:88', 'vm-uuid': '25e59513-b3bb-44c2-ac27-f9dcdacffed1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: INFO os_vif [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c')
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] attach device xml: <interface type="ethernet">
Oct 25 16:26:56 user nova-compute[74048]:   <mac address="fa:16:3e:9d:a0:88"/>
Oct 25 16:26:56 user nova-compute[74048]:   <model type="virtio"/>
Oct 25 16:26:56 user nova-compute[74048]:   <mtu size="1442"/>
Oct 25 16:26:56 user nova-compute[74048]:   <target dev="tapa03d1557-3c"/>
Oct 25 16:26:56 user nova-compute[74048]: </interface>
Oct 25 16:26:56 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No BDM found with device name hda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No VIF found with MAC fa:16:3e:96:f9:76, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updated VIF entry in instance network info cache for port a03d1557-3c0c-4b3d-922e-e62c83fadcd3. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f3e60587-d2a2-4652-b66b-777da2047bdc req-29fae44a-d470-42ff-b47d-f0869d287eac service nova] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:26:57 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:26:57 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:26:57 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:26:57</nova:creationTime>
Oct 25 16:26:57 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:26:57 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:26:57 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:26:57 user nova-compute[74048]:   <nova:owner>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:26:57 user nova-compute[74048]:   </nova:owner>
Oct 25 16:26:57 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:26:57 user nova-compute[74048]:   <nova:ports>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:26:57 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:26:57 user nova-compute[74048]:     </nova:port>
Oct 25 16:26:57 user nova-compute[74048]:     <nova:port uuid="a03d1557-3c0c-4b3d-922e-e62c83fadcd3">
Oct 25 16:26:57 user nova-compute[74048]:       <nova:ip type="fixed" address="10.10.10.234" ipVersion="4"/>
Oct 25 16:26:57 user nova-compute[74048]:     </nova:port>
Oct 25 16:26:57 user nova-compute[74048]:   </nova:ports>
Oct 25 16:26:57 user nova-compute[74048]: </nova:instance>
Oct 25 16:26:57 user nova-compute[74048]:  {{(pid=74048) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f6c61d-08f9-431d-98c3-fe2ae6eeb4be tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "interface-25e59513-b3bb-44c2-ac27-f9dcdacffed1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.094s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'flavor' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:57 user nova-compute[74048]: INFO nova.compute.manager [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Terminating instance
Oct 25 16:26:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:57 user nova-compute[74048]: INFO nova.compute.manager [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Attaching volume 4fb7a031-ac89-4076-88c6-803b96581efc to /dev/vdb
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.utils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425f4fd-7c8d-4023-aaa5-bb8dc5294363]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b4dc3-c41a-47a9-a55a-94dd31cdb34a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb632bd0-4ed9-4b95-9d09-d2eb949ebce1 req-23a2763f-7f38-4c63-8cd2-97d908cf8316 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-vif-unplugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb632bd0-4ed9-4b95-9d09-d2eb949ebce1 req-23a2763f-7f38-4c63-8cd2-97d908cf8316 service nova] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb632bd0-4ed9-4b95-9d09-d2eb949ebce1 req-23a2763f-7f38-4c63-8cd2-97d908cf8316 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb632bd0-4ed9-4b95-9d09-d2eb949ebce1 req-23a2763f-7f38-4c63-8cd2-97d908cf8316 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb632bd0-4ed9-4b95-9d09-d2eb949ebce1 req-23a2763f-7f38-4c63-8cd2-97d908cf8316 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] No waiting events found dispatching network-vif-unplugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb632bd0-4ed9-4b95-9d09-d2eb949ebce1 req-23a2763f-7f38-4c63-8cd2-97d908cf8316 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-vif-unplugged-57c5d0c7-82b5-456c-bddb-4961e048b5db for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafbc50e-ec5f-45f3-af85-d05cb970e84f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af137e9-20d9-43c6-bbbf-e7e991670a9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:58 user nova-compute[74048]: WARNING nova.compute.manager [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 for instance with vm_state active and task_state None.
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:26:58 user nova-compute[74048]: WARNING nova.compute.manager [req-cebd8893-e1a0-4f21-b4cd-53aee2a80851 req-2f6107a1-8f75-40dd-b062-a653e4f7c4db service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 for instance with vm_state active and task_state None.
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:26:58 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f41d11-4c07-426b-9f2d-158744905190]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.utils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating existing volume attachment record: 87d619fb-7608-4a65-8dcc-5330f8aae8a1 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:26:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Instance destroyed successfully.
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lazy-loading 'resources' on Instance uuid c363340c-e38a-4627-8ad5-d8a2a5cb11ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1059039460',display_name='tempest-DeleteServersTestJSON-server-1059039460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1059039460',id=3,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ce79847adab49c1b6b03facc193bacd',ramdisk_id='',reservation_id='r-jr0mnl5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1203378366',owner_user_name='tempest-DeleteServersTestJSON-1203378366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:24:52Z,user_data=None,user_id='fdc6b8b203b7400891da6e8336037245',uuid=c363340c-e38a-4627-8ad5-d8a2a5cb11ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Converting VIF {"id": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "address": "fa:16:3e:be:ec:71", "network": {"id": "dcac3743-10c5-48bd-9294-e87fa4f0dc3f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-972190762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ce79847adab49c1b6b03facc193bacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57c5d0c7-82", "ovs_interfaceid": "57c5d0c7-82b5-456c-bddb-4961e048b5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_vif [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57c5d0c7-82, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b059135d-9f66-4dd1-b391-a521e70b59d4) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:26:58 user nova-compute[74048]: INFO os_vif [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ec:71,bridge_name='br-int',has_traffic_filtering=True,id=57c5d0c7-82b5-456c-bddb-4961e048b5db,network=Network(dcac3743-10c5-48bd-9294-e87fa4f0dc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57c5d0c7-82')
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DjGFJTio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:26:58 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f270b6-52e9-4ad7-9548-ca676416eaba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:26:58 user nova-compute[74048]: No targets found.
Oct 25 16:26:58 user nova-compute[74048]: iSNS:
Oct 25 16:26:58 user nova-compute[74048]: No targets found.
Oct 25 16:26:58 user nova-compute[74048]: STATIC:
Oct 25 16:26:58 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4
Oct 25 16:26:58 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:26:58 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:26:58 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:26:58 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:26:58 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:26:58 user nova-compute[74048]: FIRMWARE:
Oct 25 16:26:58 user nova-compute[74048]: No targets found.
Oct 25 16:26:58 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:26:58 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:26:58 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c98217-3d8c-4bd5-a18c-590371efa239]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc85ea26-f868-4ad3-977c-c9b3bfdcbad8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:58 user nova-compute[74048]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 (non-flash)
Oct 25 16:26:58 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:26:58 user nova-compute[74048]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 (non-flash)
Oct 25 16:26:58 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18502e6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[24461646-02ba-4ada-94a7-296fdffa72d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f44350c-344b-45ee-b884-cdc884cd2d7c]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3964ec0-903d-4090-9a4e-95b724d14027]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cf973b-8a40-4a40-a12e-a0796a4c0f27]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b919bdf0-0161-40b2-b9d6-bc4eeae698e7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8837f-0f22-48a1-834b-0af6c65a1cba]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260]
Oct 25 16:26:58 user nova-compute[74048]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4, portal: 172.16.0.220,3260] successful.
Oct 25 16:26:58 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace72e6a-82d7-43df-b769-9bd1451987e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[60702619-e7d9-46ca-be9c-512a59f08e9c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] <== disconnect_volume: return (313ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:26:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Deleting instance files /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac_del
Oct 25 16:26:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Deletion of /opt/stack/data/nova/instances/c363340c-e38a-4627-8ad5-d8a2a5cb11ac_del complete
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74048) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 25 16:26:58 user nova-compute[74048]: INFO nova.virt.libvirt.host [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] UEFI support detected
Oct 25 16:26:58 user nova-compute[74048]: INFO nova.compute.manager [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 16:26:58 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:26:58 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:26:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:26:59 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Took 0.58 seconds to deallocate network for instance.
Oct 25 16:26:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-20f91274-14c9-4e51-9a6c-b057168d6054 req-a7249350-4692-45c1-8711-d7e551d49e59 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-20f91274-14c9-4e51-9a6c-b057168d6054 req-a7249350-4692-45c1-8711-d7e551d49e59 service nova] Acquiring lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-20f91274-14c9-4e51-9a6c-b057168d6054 req-a7249350-4692-45c1-8711-d7e551d49e59 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-20f91274-14c9-4e51-9a6c-b057168d6054 req-a7249350-4692-45c1-8711-d7e551d49e59 service nova] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-20f91274-14c9-4e51-9a6c-b057168d6054 req-a7249350-4692-45c1-8711-d7e551d49e59 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] No waiting events found dispatching network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:27:00 user nova-compute[74048]: WARNING nova.compute.manager [req-20f91274-14c9-4e51-9a6c-b057168d6054 req-a7249350-4692-45c1-8711-d7e551d49e59 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received unexpected event network-vif-plugged-57c5d0c7-82b5-456c-bddb-4961e048b5db for instance with vm_state active and task_state deleting.
Oct 25 16:27:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-45d74f59-fe3e-484a-9f24-4ed4c77e489d req-375f8c14-e96b-4dea-9b12-4790128a0d53 service nova] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Received event network-vif-deleted-57c5d0c7-82b5-456c-bddb-4961e048b5db {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:27:00 user nova-compute[74048]: INFO nova.compute.manager [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] [instance: c363340c-e38a-4627-8ad5-d8a2a5cb11ac] Took 0.97 seconds to detach 1 volumes for instance.
Oct 25 16:27:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:27:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:00 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Deleted allocations for instance c363340c-e38a-4627-8ad5-d8a2a5cb11ac
Oct 25 16:27:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dbdafad7-61fc-48b3-b994-fd1938d8df5d tempest-DeleteServersTestJSON-1203378366 tempest-DeleteServersTestJSON-1203378366-project-member] Lock "c363340c-e38a-4627-8ad5-d8a2a5cb11ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.416s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-changed-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Refreshing instance network info cache due to event network-changed-c5649328-cbf9-459d-9a05-de071a78fc14. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] Acquiring lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] Acquired lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Refreshing network info cache for port c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updated VIF entry in instance network info cache for port c5649328-cbf9-459d-9a05-de071a78fc14. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updating instance_info_cache with network_info: [{"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:27:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0b59bd55-45f0-4dce-829f-5619669cb568 req-b67b7610-05d2-42f0-9658-f1adb1fe6394 service nova] Releasing lock "refresh_cache-ddc67032-ea48-4809-9666-510c7f87f320" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG nova.compute.manager [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-changed-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG nova.compute.manager [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Refreshing instance network info cache due to event network-changed-f5b2bbce-032c-4680-9643-6ee17f25816e. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] Acquiring lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] Acquired lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG nova.network.neutron [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Refreshing network info cache for port f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG nova.objects.instance [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lazy-loading 'flavor' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG nova.network.neutron [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updated VIF entry in instance network info cache for port f5b2bbce-032c-4680-9643-6ee17f25816e. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG nova.network.neutron [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updating instance_info_cache with network_info: [{"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-32ae2c5f-ecc3-4fe5-ad3e-491e6bc8e2d1 req-7d2a2366-2e6f-4833-a133-cd7f3420bca7 service nova] Releasing lock "refresh_cache-4ae1fcb2-fa7f-44f5-8661-1271668567bd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:03 user nova-compute[74048]: INFO nova.compute.manager [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Attaching volume d82864e7-21ff-4621-b808-205be1faa6e3 to /dev/vdb
Oct 25 16:27:03 user nova-compute[74048]: DEBUG os_brick.utils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e1b03-e5f6-45b0-8225-74a81101a8c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2d11d-6564-449b-bf07-be970d445481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ad42cb-b0ac-4e36-8447-e0e74879e908]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6701d34-188b-42e4-9d01-9d2d2cbbfa05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:04 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f70770-65ec-4826-a5e2-9ed26072037b]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG os_brick.utils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updating existing volume attachment record: 024cece5-1bb9-46d2-9761-53fa21014974 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'flavor' on Instance uuid bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-changed-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Refreshing instance network info cache due to event network-changed-afed3a24-7d29-47ed-91f8-58db79a2d4e9. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] Acquiring lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] Acquired lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Refreshing network info cache for port afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updated VIF entry in instance network info cache for port afed3a24-7d29-47ed-91f8-58db79a2d4e9. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updating instance_info_cache with network_info: [{"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b579eecd-0e6a-4d8c-a7e4-5a346b015da9 req-6bdb02f9-8aea-4222-888e-8ac8aaec7703 service nova] Releasing lock "refresh_cache-15012856-adde-4587-b34e-979a0441bbaf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:27:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZrCgJOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:28 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:27:28 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:27:28 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb2594-e235-4b98-b36e-21ce69acffa3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:27:28 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f98d9-c037-457f-9c30-402b8cd4a5ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc] added
Oct 25 16:27:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a68d033-856c-4311-ab41-840b763f1115]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a87db9-1a4b-4ebf-b3bd-e41e0236549b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZrCgJOK {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZrCgJOK" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eea554-62bf-4cb5-807c-e057491e4cb6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZrCgJOK'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03f87a-8a2e-4e68-9222-16efe3d5e18e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f697bb64-4e91-4adb-87f2-af64934b7e52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "15012856-adde-4587-b34e-979a0441bbaf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19015a66-79fc-41c9-bccf-7618f096e96b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260]
Oct 25 16:27:28 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260] successful.
Oct 25 16:27:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG nova.objects.instance [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lazy-loading 'flavor' on Instance uuid 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaaf112-4c98-4d7c-8f8e-a9d4fbfea8ae]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a212964-61ca-4b70-9e23-ff242b00f5c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:28 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:28 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e77b689-a61b-4d52-ab9a-6d1e22b6635a]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZrCgJOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "15012856-adde-4587-b34e-979a0441bbaf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:28 user nova-compute[74048]: INFO nova.compute.manager [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Attaching volume 0b965b3a-1b7e-48bd-8c6c-a98f35329e1d to /dev/vdb
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG nova.objects.instance [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lazy-loading 'flavor' on Instance uuid ddc67032-ea48-4809-9666-510c7f87f320 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "15012856-adde-4587-b34e-979a0441bbaf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:28 user nova-compute[74048]: INFO nova.compute.manager [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Attaching volume e6593945-4043-4127-a844-a806194eeb25 to /dev/vdb
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.utils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7031e5b9-0b25-4384-aba0-b629effcefee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2198e-7c4a-4ef4-a3d0-419e0f813c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c26273-dd1e-4536-8b95-2c386dfbe1ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0693d88-2a0e-4646-b01e-46c80e2bc07e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:28 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:27:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6065fe08-d8c6-4d1a-bda1-e813ae51a63a]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG os_brick.utils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:28 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updating existing volume attachment record: 95094333-a873-4b85-911d-52521c9b7935 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:29 user nova-compute[74048]: INFO nova.compute.manager [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Attaching volume 1832a7e6-966c-4c50-925a-77e7972b9631 to /dev/sdc
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.utils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdc1f4b-bee7-455a-bcda-6c7ebc1fef00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd958ab-ced0-4228-ab52-942d5bef32bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b2c4af-3806-4b62-af47-d895e09cbd3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed69437-bc86-412c-a3ad-f5ecb0bd6905]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:29 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:27:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e651a7-fc9f-4444-a177-55b3c96b5197]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.utils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updating existing volume attachment record: 0e6ec8fe-0833-41b1-986a-9bd8e936491d {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26363616531326234', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363616531326234', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'flavor' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:27:29 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:27:29 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:27:29 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:27:29 user nova-compute[74048]:   <serial>4fb7a031-ac89-4076-88c6-803b96581efc</serial>
Oct 25 16:27:29 user nova-compute[74048]: </disk>
Oct 25 16:27:29 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:27:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:27:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No BDM found with device name hda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:27:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] No VIF found with MAC fa:16:3e:96:f9:76, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:27:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:27:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:27:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:27:36 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:27:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:27:37 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff12ddd-45d8-4014-8278-dfd5261d08fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:27:37 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef0ff1-05b5-451a-a3f6-c0f20e1edc70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3] added
Oct 25 16:27:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be3438a-7472-48ca-9754-21051ce47f53]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d5b21-e999-4467-a3e7-d715b9ee13f3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlTcZxvB {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlTcZxvB" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1eed21-6e7e-4ffd-a96d-d18efebfedf6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qlTcZxvB'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f20e5-cd3d-4c1f-8a6b-341471f3e41c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd58e2d-973f-48aa-b697-7d73175139c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:37 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:37 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a0d1e-b95f-496a-acf7-11bf384e434a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]
Oct 25 16:27:37 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.
Oct 25 16:27:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e6926f-9e0c-49e0-8b2e-a65a56310d80]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff37b92e-245c-494e-a5f9-0a069367c40f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:37 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:37 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:27:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:37 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:37 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:27:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3707a6c6-1554-426e-9518-ecbb7eddec33 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.508s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a014146-e7ab-4223-8724-aa6e12018ae7]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:27:37 user nova-compute[74048]: INFO nova.virt.block_device [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Booting with volume 5ac9471b-1410-45c7-906a-d94ba898b1d3 at /dev/vdc
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.utils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef7d07-8908-41b9-a101-78f5e24529d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e2f33-f6e9-4e3c-8935-ef289577d024]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e493d-8e6c-4c63-b358-7da2230212fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[04763f61-e507-4897-b67f-ac3595e373a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:37 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a015225-8a2a-4b5e-b2f0-b70d140c1ceb]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.utils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updating existing volume attachment record: 4d6efec8-7ee9-4849-a464-83ae9ecb13ea {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.utils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[420375bd-482e-4652-a677-62da8c6c35fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16beec4c-4ce5-4e5d-84eb-0d0e9ff72c99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f5c86-c96c-4596-a398-5db73094da12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9929a234-3368-4b7e-b4b1-2f1ec5657eee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:27:37 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:27:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbb344-2139-434b-8513-b601763d817c]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG os_brick.utils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:37 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating existing volume attachment record: bd36b4ae-d384-424c-85ac-509c77421fab {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23531643466653431', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643466653431', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lazy-loading 'flavor' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:27:38 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:27:38 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 16:27:38 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:27:38 user nova-compute[74048]:   <serial>d82864e7-21ff-4621-b808-205be1faa6e3</serial>
Oct 25 16:27:38 user nova-compute[74048]: </disk>
Oct 25 16:27:38 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] No VIF found with MAC fa:16:3e:b9:3a:9c, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:38 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:27:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:27:43 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:27:43 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7574MB free_disk=25.639732360839844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ddc67032-ea48-4809-9666-510c7f87f320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 15012856-adde-4587-b34e-979a0441bbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 62102eec-d6bd-45d2-a45e-bd90278a34a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:27:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.701s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-changed-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Refreshing instance network info cache due to event network-changed-ebbda323-9a84-4f24-9a1c-6c3359340b69. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] Acquiring lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] Acquired lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Refreshing network info cache for port ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updated VIF entry in instance network info cache for port ebbda323-9a84-4f24-9a1c-6c3359340b69. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updating instance_info_cache with network_info: [{"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:27:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2451fe6f-ae6b-402a-b041-79c806544f62 req-42ada1f0-8bca-4018-9b49-88336ea33a22 service nova] Releasing lock "refresh_cache-1bdfc844-9046-4f08-b276-2eee1d5fc5c3" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:27:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:27:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFyvEnbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:27:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:27:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:27:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:27:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:27:56 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:27:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[404619bb-c370-409a-85ec-3a8abe4575ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:27:56 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462a3a7-5a3c-432f-aafe-ccb3c20058ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d] added
Oct 25 16:27:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d9b506-3040-4e6e-96b9-bca5ea943841]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd7e89-adce-4de6-8516-fa7683d23f70]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFyvEnbh {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFyvEnbh" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a50dc7-6d81-46c4-af72-3b40f90818c2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFyvEnbh'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cd139f-027f-4b6e-ba0a-f578a3cb3651]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e7df26-efb6-4768-9b71-4e1038508b8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c95ef9-a330-4eef-ae56-b50271bf6ebf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260]
Oct 25 16:27:57 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260] successful.
Oct 25 16:27:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d8e5f-8bbb-444d-b2a5-ec8a2819c6b5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b5444-5689-4a88-9338-634056fe6aba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:27:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:27:57 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:27:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ffa72-9e96-45dd-b3a0-23ab8e29ab8f]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:27:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFyvEnbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23437306232383264', 'path': '/dev/sde'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437306232383264', 'path': '/dev/sde'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'flavor' on Instance uuid bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:27:58 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:27:58 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:27:58 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:27:58 user nova-compute[74048]:   <serial>0b965b3a-1b7e-48bd-8c6c-a98f35329e1d</serial>
Oct 25 16:27:58 user nova-compute[74048]: </disk>
Oct 25 16:27:58 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:27:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No VIF found with MAC fa:16:3e:05:33:ff, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:28:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:28:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:28:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQifvDUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:14 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9fbbf7-922f-44db-8a97-db1fb5fa4ea8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:28:14 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9d8d04-8831-47c2-8ea3-b990f5c63620]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25] added
Oct 25 16:28:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkaKdcZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.110s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[311fa005-7271-4266-b2e0-4ee5407d7d14]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[560fc3b2-f635-48f4-aa2a-fe0bda0697c0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQifvDUG {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQifvDUG" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce059f26-4951-42e1-a3dc-f81b883cfa6a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQifvDUG'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a67e359-1edd-4f91-8b44-e1e6b0d2a185]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3164e4ce-a1e4-49cb-877c-3d5fbb33fe1f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-784ed4bc-bae6-4ef1-aea3-fa49294dbb59 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 71.411s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ee022-a80d-48d3-9c73-6eaabf8009aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260]
Oct 25 16:28:15 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b07bcc-c92e-42df-bf67-ba283e42e9e5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2407f06-eabf-4e6d-b974-1c83ee843690]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:15 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbedeaa-1861-4722-bc8f-86e8e4e8df94]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQifvDUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:28:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9b51fc32-7c9a-4e25-a456-2f3585f05135 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.745s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:16 user nova-compute[74048]: INFO nova.compute.manager [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Rebuilding instance
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23861653939383735', 'path': '/dev/sdf'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861653939383735', 'path': '/dev/sdf'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.371s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:16 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:16 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:28:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:16 user nova-compute[74048]: INFO nova.compute.manager [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Detaching volume 4fb7a031-ac89-4076-88c6-803b96581efc
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:28:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Creating image(s)
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Ensure instance console log exists: /opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Start _get_guest_xml network_info=[{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '117e6aa5-2a65-48a6-8ee4-5b08222bdc9e', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKwJdEpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62102eec-d6bd-45d2-a45e-bd90278a34a1', 'attached_at': '', 'detached_at': '', 'volume_id': '43b1a248-a4da-4e54-8a17-812e5c148286', 'serial': '43b1a248-a4da-4e54-8a17-812e5c148286'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '060dd66d-1fe4-44b8-a33d-fc6ab781398a', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIjDEgrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62102eec-d6bd-45d2-a45e-bd90278a34a1', 'attached_at': '', 'detached_at': '', 'volume_id': '18ab6feb-5c15-432c-8da9-4b123856f9ea', 'serial': '18ab6feb-5c15-432c-8da9-4b123856f9ea'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'bd36b4ae-d384-424c-85ac-509c77421fab', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alJdozIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62102eec-d6bd-45d2-a45e-bd90278a34a1', 'attached_at': '', 'detached_at': '', 'volume_id': '5ac9471b-1410-45c7-906a-d94ba898b1d3', 'serial': '5ac9471b-1410-45c7-906a-d94ba898b1d3'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b55e6-9684-4f91-be18-7426a1b00852]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:28:16 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.objects.instance [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lazy-loading 'flavor' on Instance uuid 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:16 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:16 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[133fdfa9-3c06-4c3f-aef5-0ce6c9d5edfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631] added
Oct 25 16:28:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKwJdEpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:16 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:16 user nova-compute[74048]: INFO nova.virt.block_device [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Attempting to driver detach volume 4fb7a031-ac89-4076-88c6-803b96581efc from mountpoint /dev/vdb
Oct 25 16:28:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca3595-6c72-413a-970c-1402754e48c4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] attach device xml: <disk type="block" device="disk">
Oct 25 16:28:16 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:16 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:28:16 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:16 user nova-compute[74048]:   <serial>e6593945-4043-4127-a844-a806194eeb25</serial>
Oct 25 16:28:16 user nova-compute[74048]: </disk>
Oct 25 16:28:16 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479bd27-99d6-4aaf-ba03-6985a307cf3e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkaKdcZL {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Attempting to detach device vdb from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:16 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:16 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:28:16 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:16 user nova-compute[74048]:   <serial>4fb7a031-ac89-4076-88c6-803b96581efc</serial>
Oct 25 16:28:16 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 16:28:16 user nova-compute[74048]: </disk>
Oct 25 16:28:16 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mkaKdcZL" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f8859-c669-4c6c-8bbb-89745606ae36]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully detached device vdb from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the persistent domain config.
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:16 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:16 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:28:16 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:16 user nova-compute[74048]:   <serial>4fb7a031-ac89-4076-88c6-803b96581efc</serial>
Oct 25 16:28:16 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 16:28:16 user nova-compute[74048]: </disk>
Oct 25 16:28:16 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mkaKdcZL'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1e2ac4-acd1-4aab-b9ce-9abce4e92d62]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[389ba51d-c0ee-4969-9a03-7db57fc6cad8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-e7a2e980-8ac1-4da3-8a76-b25eb751aa54 req-9b60bb31-5dc7-41a4-bf34-291cdfb5e92e service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-unplugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e7a2e980-8ac1-4da3-8a76-b25eb751aa54 req-9b60bb31-5dc7-41a4-bf34-291cdfb5e92e service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e7a2e980-8ac1-4da3-8a76-b25eb751aa54 req-9b60bb31-5dc7-41a4-bf34-291cdfb5e92e service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e7a2e980-8ac1-4da3-8a76-b25eb751aa54 req-9b60bb31-5dc7-41a4-bf34-291cdfb5e92e service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-e7a2e980-8ac1-4da3-8a76-b25eb751aa54 req-9b60bb31-5dc7-41a4-bf34-291cdfb5e92e service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-unplugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:16 user nova-compute[74048]: WARNING nova.compute.manager [req-e7a2e980-8ac1-4da3-8a76-b25eb751aa54 req-9b60bb31-5dc7-41a4-bf34-291cdfb5e92e service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-unplugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state active and task_state rebuilding.
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cce6f9-f7cb-4ac1-866c-35111c0efd55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260]
Oct 25 16:28:16 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5993df80-cc71-4522-89f5-f243d583c1a1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd6f632-705e-4271-abee-2cc8456189de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f23ff2-0bb0-4b4d-a1f3-2bfd898e51dd]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkaKdcZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] No VIF found with MAC fa:16:3e:ba:1b:10, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG os_brick.utils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c31aeff-69ac-409e-8640-9a8bf001a2d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408473a-66b0-42ef-aa19-732378bcc170]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[254b46ab-e8f9-4476-bb6d-91d82c0111aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93ca8f-524c-4ce2-afc5-014430547cb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:28:17 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7b66d0-ee22-4a2e-9c6a-5119302f14d1]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.utils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e8efbd8-c33b-45ca-b9ee-0ad7fad6d3bc tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "15012856-adde-4587-b34e-979a0441bbaf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.280s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.compute.manager [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Swapping volume d82864e7-21ff-4621-b808-205be1faa6e3 for a90a40ec-02fa-434a-8905-17eb88a981a4
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.compute.manager [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Detaching volume 0b965b3a-1b7e-48bd-8c6c-a98f35329e1d
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.virt.block_device [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Attempting to driver detach volume 0b965b3a-1b7e-48bd-8c6c-a98f35329e1d from mountpoint /dev/vdb
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Attempting to detach device vdb from instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:17 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:17 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:28:17 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:17 user nova-compute[74048]:   <serial>0b965b3a-1b7e-48bd-8c6c-a98f35329e1d</serial>
Oct 25 16:28:17 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:28:17 user nova-compute[74048]: </disk>
Oct 25 16:28:17 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Successfully detached device vdb from instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae from the persistent domain config.
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:17 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:17 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:28:17 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:17 user nova-compute[74048]:   <serial>0b965b3a-1b7e-48bd-8c6c-a98f35329e1d</serial>
Oct 25 16:28:17 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:28:17 user nova-compute[74048]: </disk>
Oct 25 16:28:17 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance destroyed successfully.
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance destroyed successfully.
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-166486840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382712036',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjjojn8YvnWNnajLosTW7x1rEzFmEFfnM1fIXglgkUuo3CmTU0gSBineq0pi5f4jomsN5QQoXslmxH2A46axyunIDAhWEP2hpfFpWoacytfPoUYSAhxnWVokf1k7zVdXQ==',key_name='tempest-keypair-734782483',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1265f3be7364d58b49cca5d7b7be97a',ramdisk_id='',reservation_id='r-tw4vdi7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-599396862',owner_user_name='tempest-ServerActionsV293TestJSON-599396862-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0503e1c84bd641b48406fcf9dbdda397',uuid=1bdfc844-9046-4f08-b276-2eee1d5fc5c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converting VIF {"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebbda323-9a, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc842b82-666d-4a4c-99f0-d8cf7ac8a7df) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:17 user nova-compute[74048]: INFO os_vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a')
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:17 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] volume_snapshot_create: create_info: {'snapshot_id': 'd98e3098-b381-4415-ae07-ef25be69ddf2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74048) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] snap xml: <domainsnapshot>
Oct 25 16:28:17 user nova-compute[74048]:   <disks>
Oct 25 16:28:17 user nova-compute[74048]:     <disk name="/dev/sdf" snapshot="external" type="file">
Oct 25 16:28:17 user nova-compute[74048]:       <source file="/dev/new_file"/>
Oct 25 16:28:17 user nova-compute[74048]:     </disk>
Oct 25 16:28:17 user nova-compute[74048]:     <disk name="vda" snapshot="no"/>
Oct 25 16:28:17 user nova-compute[74048]:   </disks>
Oct 25 16:28:17 user nova-compute[74048]: </domainsnapshot>
Oct 25 16:28:17 user nova-compute[74048]:  {{(pid=74048) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] Lazy-loading 'system_metadata' on Instance uuid 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     rv = execute(f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     six.reraise(c, e, tb)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     raise value
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     rv = meth(*args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     self._volume_snapshot_create(context, instance, guest,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     rv = execute(f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     six.reraise(c, e, tb)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     raise value
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     rv = meth(*args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] 
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9a47e7c0-2418-4ae5-b29b-2ef947539af1 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] volume_snapshot_delete: delete_info: {'volume_id': 'e6593945-4043-4127-a844-a806194eeb25'} {{(pid=74048) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [None req-9a47e7c0-2418-4ae5-b29b-2ef947539af1 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf]     if delete_info['type'] != 'qcow2':
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] KeyError: 'type'
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [instance: 15012856-adde-4587-b34e-979a0441bbaf] 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot d98e3098-b381-4415-ae07-ef25be69ddf2 could not be found.
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise value
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot d98e3098-b381-4415-ae07-ef25be69ddf2 could not be found. (HTTP 404) (Request-ID: req-a37a80f6-d094-4ade-8874-b072cde68420)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot d98e3098-b381-4415-ae07-ef25be69ddf2 could not be found.
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] <== connect_volume: return (2850ms) {'type': 'block', 'scsi_wwn': '23563363262363763', 'path': '/dev/sdg'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563363262363763', 'path': '/dev/sdg'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.344s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:17 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:17 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server [None req-a9db254c-e3c6-4209-ad9f-1475db6fd1c8 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise value
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver [None req-9a47e7c0-2418-4ae5-b29b-2ef947539af1 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-461db173-0e45-44e1-b8e3-c32cc5db2b14)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 16:28:17 user nova-compute[74048]: ERROR nova.virt.libvirt.driver 
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server [None req-9a47e7c0-2418-4ae5-b29b-2ef947539af1 tempest-VolumesAssistedSnapshotsTest-1055853463 tempest-VolumesAssistedSnapshotsTest-1055853463-project] Exception during message handling: KeyError: 'type'
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 25 16:28:17 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lazy-loading 'flavor' on Instance uuid ddc67032-ea48-4809-9666-510c7f87f320 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61859bd-a1c3-401f-b1db-0071c206c6d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:28:17 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17593933-e882-45f2-a144-351a15172335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286] added
Oct 25 16:28:17 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:28:17 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:17 user nova-compute[74048]:   <source dev="/dev/sdg"/>
Oct 25 16:28:17 user nova-compute[74048]:   <target dev="sdc" bus="scsi"/>
Oct 25 16:28:17 user nova-compute[74048]:   <serial>1832a7e6-966c-4c50-925a-77e7972b9631</serial>
Oct 25 16:28:17 user nova-compute[74048]:   <address type="drive" controller="0" unit="2"/>
Oct 25 16:28:17 user nova-compute[74048]: </disk>
Oct 25 16:28:17 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155f05a-16e9-4032-91b7-02dc6881ef9b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a4742-0258-47ff-bc74-eb299f39e818]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKwJdEpD {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKwJdEpD" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea531f3c-c693-42b9-8ce3-344017582d24]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKwJdEpD'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d17d765-ec67-40e8-b6ce-a15d9da29de6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea698fd-8a3c-4ac4-996f-f85f160c11d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:17 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536e4c3-ab52-4fc7-a30f-32587c527203]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260]
Oct 25 16:28:17 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:17 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef3b74-34b8-4ed5-9a54-9b45fab84949]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d30abf1-6422-4961-9377-76b2f83f0143]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df267198-b81c-46ce-a295-4c13d48a19d5]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKwJdEpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "15012856-adde-4587-b34e-979a0441bbaf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:18 user nova-compute[74048]: INFO nova.compute.manager [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Detaching volume e6593945-4043-4127-a844-a806194eeb25
Oct 25 16:28:18 user nova-compute[74048]: INFO nova.virt.block_device [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Attempting to driver detach volume e6593945-4043-4127-a844-a806194eeb25 from mountpoint /dev/vdb
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Attempting to detach device vdb from instance 15012856-adde-4587-b34e-979a0441bbaf from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:18 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:18 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:28:18 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:18 user nova-compute[74048]:   <serial>e6593945-4043-4127-a844-a806194eeb25</serial>
Oct 25 16:28:18 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:28:18 user nova-compute[74048]: </disk>
Oct 25 16:28:18 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:18 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Successfully detached device vdb from instance 15012856-adde-4587-b34e-979a0441bbaf from the persistent domain config.
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15012856-adde-4587-b34e-979a0441bbaf from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:18 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:18 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:28:18 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:28:18 user nova-compute[74048]:   <serial>e6593945-4043-4127-a844-a806194eeb25</serial>
Oct 25 16:28:18 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:28:18 user nova-compute[74048]: </disk>
Oct 25 16:28:18 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No BDM found with device name sda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] No VIF found with MAC fa:16:3e:cc:0e:d6, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-cba25234-5356-41f2-9b95-47e4b1583fc5 req-3be328ce-32eb-4e53-b851-3b11a6c21882 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cba25234-5356-41f2-9b95-47e4b1583fc5 req-3be328ce-32eb-4e53-b851-3b11a6c21882 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cba25234-5356-41f2-9b95-47e4b1583fc5 req-3be328ce-32eb-4e53-b851-3b11a6c21882 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cba25234-5356-41f2-9b95-47e4b1583fc5 req-3be328ce-32eb-4e53-b851-3b11a6c21882 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-cba25234-5356-41f2-9b95-47e4b1583fc5 req-3be328ce-32eb-4e53-b851-3b11a6c21882 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:18 user nova-compute[74048]: WARNING nova.compute.manager [req-cba25234-5356-41f2-9b95-47e4b1583fc5 req-3be328ce-32eb-4e53-b851-3b11a6c21882 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state active and task_state rebuilding.
Oct 25 16:28:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-637d92ce-bb2a-4821-94ee-313278250c6a tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.703s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== connect_volume: return (2695ms) {'type': 'block', 'scsi_wwn': '26530373865353036', 'path': '/dev/sdh'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530373865353036', 'path': '/dev/sdh'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.549s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abefd9d-7d17-4ac3-b3de-f4c38b30dd9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:19 user nova-compute[74048]: No targets found.
Oct 25 16:28:19 user nova-compute[74048]: iSNS:
Oct 25 16:28:19 user nova-compute[74048]: No targets found.
Oct 25 16:28:19 user nova-compute[74048]: STATIC:
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:28:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:19 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:19 user nova-compute[74048]: No targets found.
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:19 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:19 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIjDEgrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:19 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58c345b-e1e7-49be-a4b4-db8c4a1585a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c076d83-b3e8-4e3f-8107-000ba899f878]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185832e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c940a4f3-e1a5-4f4c-854b-975d2df64e11]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50e557-2208-412d-b871-ff147d717afc]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d0664-1495-4207-8b83-031b8129a808]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cdd287-9323-4a62-883e-4a7a68e67c44]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[de599072-07ab-4e3b-a86c-fe7e81cee9ce]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f84c303-36b9-410b-9979-c70c918cc1b2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]
Oct 25 16:28:19 user nova-compute[74048]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[be040ad4-b6b9-405c-a034-072b67e761bf]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== disconnect_volume: return (1891ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Deleting instance files /opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3_del
Oct 25 16:28:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Deletion of /opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3_del complete
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.309s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:19 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:19 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed0ec1-8674-465a-92f5-d020b832d72e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:28:19 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[156be7d1-9a7e-49e8-bf01-9a87d9d76908]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea] added
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3358097-26d3-4657-9e42-faa597d43a9a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b03a819-e862-4237-b66b-c5bf5b49f19a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIjDEgrP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIjDEgrP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32247a7-d355-4ddb-8da9-0dc0fb8eb6a8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIjDEgrP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3509de-6300-4557-a42a-52c6fe7ccb2c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de3956-e025-45f6-be6c-7e89c2aafc21]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:19 user nova-compute[74048]: INFO nova.compute.manager [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Detaching volume 1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:19 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 could not be found.
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:19 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[876ee85c-5361-4ee9-8181-21437f2deaf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260]
Oct 25 16:28:19 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de43f9-d83f-420c-b7f8-0b03de983f21]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: INFO nova.virt.block_device [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Attempting to driver detach volume 1832a7e6-966c-4c50-925a-77e7972b9631 from mountpoint /dev/sdc
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Attempting to detach device sdc from instance ddc67032-ea48-4809-9666-510c7f87f320 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:19 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:19 user nova-compute[74048]:   <source dev="/dev/sdg"/>
Oct 25 16:28:19 user nova-compute[74048]:   <target dev="sdc" bus="scsi"/>
Oct 25 16:28:19 user nova-compute[74048]:   <serial>1832a7e6-966c-4c50-925a-77e7972b9631</serial>
Oct 25 16:28:19 user nova-compute[74048]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 16:28:19 user nova-compute[74048]: </disk>
Oct 25 16:28:19 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Successfully detached device sdc from instance ddc67032-ea48-4809-9666-510c7f87f320 from the persistent domain config.
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ddc67032-ea48-4809-9666-510c7f87f320 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:28:19 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:19 user nova-compute[74048]:   <source dev="/dev/sdg"/>
Oct 25 16:28:19 user nova-compute[74048]:   <target dev="sdc" bus="scsi"/>
Oct 25 16:28:19 user nova-compute[74048]:   <serial>1832a7e6-966c-4c50-925a-77e7972b9631</serial>
Oct 25 16:28:19 user nova-compute[74048]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 16:28:19 user nova-compute[74048]: </disk>
Oct 25 16:28:19 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c019e9ad-5b9c-495b-9e95-b087ebef84b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea7bc7-b5d3-4d5e-9a13-d36acf28dc95]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIjDEgrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:28:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ddc67032-ea48-4809-9666-510c7f87f320 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== connect_volume: return (1699ms) {'type': 'block', 'scsi_wwn': '23439353438653334', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439353438653334', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.141s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alJdozIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:20 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e24cb-45b8-4f23-ad24-4051353b0c1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:20 user nova-compute[74048]: No targets found.
Oct 25 16:28:20 user nova-compute[74048]: iSNS:
Oct 25 16:28:20 user nova-compute[74048]: No targets found.
Oct 25 16:28:20 user nova-compute[74048]: STATIC:
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:20 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:20 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:20 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:20 user nova-compute[74048]: No targets found.
Oct 25 16:28:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:20 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:20 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6ca83-c087-40e3-b3e2-5af15819646e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca464d1-333b-4625-be92-755d1aabbd35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1858159120>, {}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Disconnecting from: [] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== disconnect_volume: return (1227ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.063s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:20 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:20 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1619a3-5db4-413e-96fb-71ea29508d4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:28:20 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae85a8ab-f632-4d45-9b53-79c1fc33f410]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3] added
Oct 25 16:28:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadaa8df-37d1-4002-b112-554ac9b731eb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d602b-7d22-41e5-b7c7-4232be8a1f50]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alJdozIX {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alJdozIX" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e27bb-75b0-4d8d-8c6e-03e8506753fb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'alJdozIX'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31936b4b-f8a0-42c8-a428-c5de8c42f900]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc7674b-a4f7-49f0-8b9d-6c1823d881e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b52b5-05e2-40b7-b284-e4cd20743f55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260]
Oct 25 16:28:21 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1fb4d7-ca7e-4806-b898-678ecd5a7ef2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae34dd39-5a6e-426c-ad0e-48ef1020df21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2727b2f2-036f-4ca8-ae84-34c79272343e]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alJdozIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Preparing to wait for external event volume-reimaged-0f82c659-17b7-4d55-a2a5-ddc7172ba044 {{(pid=74048) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23762383764613462', 'path': '/dev/sdi'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762383764613462', 'path': '/dev/sdi'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.objects.instance [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lazy-loading 'pci_devices' on Instance uuid 62102eec-d6bd-45d2-a45e-bd90278a34a1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:28:22 user nova-compute[74048]:   <uuid>62102eec-d6bd-45d2-a45e-bd90278a34a1</uuid>
Oct 25 16:28:22 user nova-compute[74048]:   <name>instance-0000000b</name>
Oct 25 16:28:22 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:28:22 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:28:22 user nova-compute[74048]:   <metadata>
Oct 25 16:28:22 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:28:22 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:28:22 user nova-compute[74048]:       <nova:name>tempest-device-tagging-server-1903933819</nova:name>
Oct 25 16:28:22 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:28:16</nova:creationTime>
Oct 25 16:28:22 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:28:22 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:28:22 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:28:22 user nova-compute[74048]:       <nova:owner>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:user uuid="70a32b6dc0a247408bdcbd2c9f5e6fc7">tempest-TaggedBootDevicesTest_v242-270679145-project-member</nova:user>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:project uuid="0aedadab87724e0c9a581890f0cccb12">tempest-TaggedBootDevicesTest_v242-270679145</nova:project>
Oct 25 16:28:22 user nova-compute[74048]:       </nova:owner>
Oct 25 16:28:22 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:28:22 user nova-compute[74048]:       <nova:ports>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="16da64ac-473b-4a8a-9e0d-de230daee02f">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="4845e63d-9ded-4e12-9329-8c34f48cf3aa">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.74" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="321e2058-c668-430f-8bbd-cd654b7ed753">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="02e9da4d-a459-499a-9cc6-2b46f90a7e5d">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:         <nova:port uuid="2a302c98-fde0-490f-8ac9-7cd487954e70">
Oct 25 16:28:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 16:28:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:22 user nova-compute[74048]:       </nova:ports>
Oct 25 16:28:22 user nova-compute[74048]:     </nova:instance>
Oct 25 16:28:22 user nova-compute[74048]:   </metadata>
Oct 25 16:28:22 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:28:22 user nova-compute[74048]:     <system>
Oct 25 16:28:22 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:28:22 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:28:22 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:28:22 user nova-compute[74048]:       <entry name="serial">62102eec-d6bd-45d2-a45e-bd90278a34a1</entry>
Oct 25 16:28:22 user nova-compute[74048]:       <entry name="uuid">62102eec-d6bd-45d2-a45e-bd90278a34a1</entry>
Oct 25 16:28:22 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:28:22 user nova-compute[74048]:     </system>
Oct 25 16:28:22 user nova-compute[74048]:   </sysinfo>
Oct 25 16:28:22 user nova-compute[74048]:   <os>
Oct 25 16:28:22 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:28:22 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:28:22 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:28:22 user nova-compute[74048]:   </os>
Oct 25 16:28:22 user nova-compute[74048]:   <features>
Oct 25 16:28:22 user nova-compute[74048]:     <acpi/>
Oct 25 16:28:22 user nova-compute[74048]:     <apic/>
Oct 25 16:28:22 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:28:22 user nova-compute[74048]:   </features>
Oct 25 16:28:22 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:28:22 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:28:22 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:28:22 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:28:22 user nova-compute[74048]:   </clock>
Oct 25 16:28:22 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:28:22 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:28:22 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:28:22 user nova-compute[74048]:   </cpu>
Oct 25 16:28:22 user nova-compute[74048]:   <devices>
Oct 25 16:28:22 user nova-compute[74048]:     <disk type="file" device="cdrom">
Oct 25 16:28:22 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 16:28:22 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1/disk.config"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="hda" bus="ide"/>
Oct 25 16:28:22 user nova-compute[74048]:     </disk>
Oct 25 16:28:22 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:28:22 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:22 user nova-compute[74048]:       <source dev="/dev/sdh"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <serial>43b1a248-a4da-4e54-8a17-812e5c148286</serial>
Oct 25 16:28:22 user nova-compute[74048]:     </disk>
Oct 25 16:28:22 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:28:22 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:22 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <serial>18ab6feb-5c15-432c-8da9-4b123856f9ea</serial>
Oct 25 16:28:22 user nova-compute[74048]:     </disk>
Oct 25 16:28:22 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:28:22 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:28:22 user nova-compute[74048]:       <source dev="/dev/sdi"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="vdc" bus="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <serial>5ac9471b-1410-45c7-906a-d94ba898b1d3</serial>
Oct 25 16:28:22 user nova-compute[74048]:     </disk>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:9d:42:d2"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tap16da64ac-47"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:45:fd:f1"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tap4845e63d-9d"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:33:aa:aa"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tap1e3304ef-0e"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:81:5d:be"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tape0d7ff22-cd"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:2f:56:a1"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tap321e2058-c6"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:8e:9d:34"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tap02e9da4d-a4"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:22 user nova-compute[74048]:       <mac address="fa:16:3e:8e:6b:18"/>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:22 user nova-compute[74048]:       <target dev="tap2a302c98-fd"/>
Oct 25 16:28:22 user nova-compute[74048]:     </interface>
Oct 25 16:28:22 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:28:22 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1/console.log" append="off"/>
Oct 25 16:28:22 user nova-compute[74048]:     </serial>
Oct 25 16:28:22 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:28:22 user nova-compute[74048]:     <video>
Oct 25 16:28:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:22 user nova-compute[74048]:     </video>
Oct 25 16:28:22 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:28:22 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:28:22 user nova-compute[74048]:     </rng>
Oct 25 16:28:22 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:28:22 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:28:22 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:28:22 user nova-compute[74048]:     </memballoon>
Oct 25 16:28:22 user nova-compute[74048]:   </devices>
Oct 25 16:28:22 user nova-compute[74048]: </domain>
Oct 25 16:28:22 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1739f210-333d-5de7-9c9d-cd66c8f71e0c', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16da64ac-47, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16da64ac-47, col_values=(('qos', UUID('3811e6ff-ff22-420d-8af4-3c4eeb8d698c')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16da64ac-47, col_values=(('external_ids', {'iface-id': '16da64ac-473b-4a8a-9e0d-de230daee02f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:42:d2', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47')
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '832cdb86-f57f-5ddd-b468-23e11a73e9a8', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4845e63d-9d, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4845e63d-9d, col_values=(('qos', UUID('7cc3b02d-2d0f-42cd-bd36-0197bab79ceb')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4845e63d-9d, col_values=(('external_ids', {'iface-id': '4845e63d-9ded-4e12-9329-8c34f48cf3aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:fd:f1', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d')
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7db7cc86-0be4-5a5a-afc5-ac976df0f498', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e3304ef-0e, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e3304ef-0e, col_values=(('qos', UUID('da5ffc1e-828d-4743-b10f-26e22119ba51')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e3304ef-0e, col_values=(('external_ids', {'iface-id': '1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:aa:aa', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e')
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94807fde-7e25-5a23-b6fb-e8457abb37e5', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0d7ff22-cd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0d7ff22-cd, col_values=(('qos', UUID('25cd3c42-ceea-43db-8023-f3105f7e1f36')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0d7ff22-cd, col_values=(('external_ids', {'iface-id': 'e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:5d:be', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd')
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '625ad905-70e7-5dc9-938b-33bb9798f87d', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap321e2058-c6, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap321e2058-c6, col_values=(('qos', UUID('e39c367c-b542-4624-ba4c-054e5111712b')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap321e2058-c6, col_values=(('external_ids', {'iface-id': '321e2058-c668-430f-8bbd-cd654b7ed753', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:56:a1', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6')
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04d2a579-156f-57f2-ace5-627c92bc816c', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02e9da4d-a4, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02e9da4d-a4, col_values=(('qos', UUID('70024fd2-a3af-409d-b8f4-f881b925f9da')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02e9da4d-a4, col_values=(('external_ids', {'iface-id': '02e9da4d-a459-499a-9cc6-2b46f90a7e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:9d:34', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4')
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:26:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fa7f0df-08cb-5a98-9d12-9086990526e4', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a302c98-fd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a302c98-fd, col_values=(('qos', UUID('7d234c6d-ab5a-46db-b0f9-5c11306dc78e')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a302c98-fd, col_values=(('external_ids', {'iface-id': '2a302c98-fde0-490f-8ac9-7cd487954e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:6b:18', 'vm-uuid': '62102eec-d6bd-45d2-a45e-bd90278a34a1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:22 user nova-compute[74048]: INFO os_vif [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd')
Oct 25 16:28:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] No BDM found with device name hda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] No VIF found with MAC fa:16:3e:9d:42:d2, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] No VIF found with MAC fa:16:3e:2f:56:a1, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Using config drive
Oct 25 16:28:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Creating config drive at /opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1/disk.config
Oct 25 16:28:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbmvexwx2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbmvexwx2" returned: 0 in 0.053s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-4d4edabe-d690-40db-9940-1fe397b1fd75 req-ec65ef81-6eb9-4789-8075-8ffff89074c1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4d4edabe-d690-40db-9940-1fe397b1fd75 req-ec65ef81-6eb9-4789-8075-8ffff89074c1 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4d4edabe-d690-40db-9940-1fe397b1fd75 req-ec65ef81-6eb9-4789-8075-8ffff89074c1 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4d4edabe-d690-40db-9940-1fe397b1fd75 req-ec65ef81-6eb9-4789-8075-8ffff89074c1 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-4d4edabe-d690-40db-9940-1fe397b1fd75 req-ec65ef81-6eb9-4789-8075-8ffff89074c1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:24 user nova-compute[74048]: WARNING nova.compute.manager [req-4d4edabe-d690-40db-9940-1fe397b1fd75 req-ec65ef81-6eb9-4789-8075-8ffff89074c1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f for instance with vm_state building and task_state spawning.
Oct 25 16:28:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-d17d0cb5-f26d-4888-b142-ff04ac4be160 req-7c94b564-b6b6-4534-a12f-f32479190770 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d17d0cb5-f26d-4888-b142-ff04ac4be160 req-7c94b564-b6b6-4534-a12f-f32479190770 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d17d0cb5-f26d-4888-b142-ff04ac4be160 req-7c94b564-b6b6-4534-a12f-f32479190770 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d17d0cb5-f26d-4888-b142-ff04ac4be160 req-7c94b564-b6b6-4534-a12f-f32479190770 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-d17d0cb5-f26d-4888-b142-ff04ac4be160 req-7c94b564-b6b6-4534-a12f-f32479190770 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:25 user nova-compute[74048]: WARNING nova.compute.manager [req-d17d0cb5-f26d-4888-b142-ff04ac4be160 req-7c94b564-b6b6-4534-a12f-f32479190770 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa for instance with vm_state building and task_state spawning.
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-8a80bb9c-33e8-49c2-9644-938e0b0bc811 req-9871509c-da91-4536-8248-e02c9ab676ae service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8a80bb9c-33e8-49c2-9644-938e0b0bc811 req-9871509c-da91-4536-8248-e02c9ab676ae service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8a80bb9c-33e8-49c2-9644-938e0b0bc811 req-9871509c-da91-4536-8248-e02c9ab676ae service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8a80bb9c-33e8-49c2-9644-938e0b0bc811 req-9871509c-da91-4536-8248-e02c9ab676ae service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-8a80bb9c-33e8-49c2-9644-938e0b0bc811 req-9871509c-da91-4536-8248-e02c9ab676ae service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:26 user nova-compute[74048]: WARNING nova.compute.manager [req-8a80bb9c-33e8-49c2-9644-938e0b0bc811 req-9871509c-da91-4536-8248-e02c9ab676ae service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 for instance with vm_state building and task_state spawning.
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:26 user nova-compute[74048]: WARNING nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f for instance with vm_state building and task_state spawning.
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:26 user nova-compute[74048]: WARNING nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f for instance with vm_state building and task_state spawning.
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:26 user nova-compute[74048]: WARNING nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f for instance with vm_state building and task_state spawning.
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:26 user nova-compute[74048]: WARNING nova.compute.manager [req-008a782b-be68-4c73-b206-ddafd229a284 req-0d3ca08d-53c5-4a2d-bec7-e8124c949eda service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d for instance with vm_state building and task_state spawning.
Oct 25 16:28:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:27 user nova-compute[74048]: WARNING nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa for instance with vm_state building and task_state spawning.
Oct 25 16:28:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:27 user nova-compute[74048]: WARNING nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc for instance with vm_state building and task_state spawning.
Oct 25 16:28:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:27 user nova-compute[74048]: WARNING nova.compute.manager [req-b1267fed-b1b7-4fc0-9b5a-93caa10497a4 req-859497d9-59a5-4a0f-85a4-66514a3151a7 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc for instance with vm_state building and task_state spawning.
Oct 25 16:28:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:28 user nova-compute[74048]: WARNING nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 for instance with vm_state building and task_state spawning.
Oct 25 16:28:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:28 user nova-compute[74048]: WARNING nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 for instance with vm_state building and task_state spawning.
Oct 25 16:28:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:28 user nova-compute[74048]: WARNING nova.compute.manager [req-73e5f1a8-3a5f-47af-a653-f9d549c51479 req-e6dc2963-66c4-42c3-8095-4c1dcca3c1c2 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 for instance with vm_state building and task_state spawning.
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-6bc5237b-d2b9-4195-bd7e-09e748b30c0a req-de6989b3-1629-467b-b9c3-83f95c5351df service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6bc5237b-d2b9-4195-bd7e-09e748b30c0a req-de6989b3-1629-467b-b9c3-83f95c5351df service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6bc5237b-d2b9-4195-bd7e-09e748b30c0a req-de6989b3-1629-467b-b9c3-83f95c5351df service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6bc5237b-d2b9-4195-bd7e-09e748b30c0a req-de6989b3-1629-467b-b9c3-83f95c5351df service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-6bc5237b-d2b9-4195-bd7e-09e748b30c0a req-de6989b3-1629-467b-b9c3-83f95c5351df service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:29 user nova-compute[74048]: WARNING nova.compute.manager [req-6bc5237b-d2b9-4195-bd7e-09e748b30c0a req-de6989b3-1629-467b-b9c3-83f95c5351df service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d for instance with vm_state building and task_state spawning.
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:28:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance spawned successfully.
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:29 user nova-compute[74048]: INFO nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Took 13.12 seconds to spawn the instance on the hypervisor.
Oct 25 16:28:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:28:29 user nova-compute[74048]: INFO nova.compute.manager [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Took 120.13 seconds to build instance.
Oct 25 16:28:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-196808f6-aa8e-48e7-b056-30bdc8fd7218 tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 120.290s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:28:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:28:31 user nova-compute[74048]: INFO nova.compute.claims [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Claim successful on node user
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:28:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.policy [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c809d630a78d4ce4bef9a9462543d2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad2347aaae1424681b490608fde8b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:28:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Creating image(s)
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "/opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "/opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.221s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk 1073741824" returned: 0 in 0.059s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.222s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Successfully created port: 56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Cannot resize image /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Ensure instance console log exists: /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Successfully updated port: 56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquired lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-changed-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Refreshing instance network info cache due to event network-changed-56d3478b-943a-4c3b-9864-0b6e4c519e4a. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] Acquiring lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Releasing lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance network_info: |[{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] Acquired lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Refreshing network info cache for port 56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Start _get_guest_xml network_info=[{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:28:34 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:34 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127080201',display_name='tempest-tempest.common.compute-instance-2127080201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127080201',id=12,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF/Ob8zVZV2VbmuGOLtxWdy/S5pTQppE8p4hDAWaGtFkeEynINdBiyI+HYRih4nviB5WYM5HaOiWdBqdpoYiqM9tKvfSHL3HINtv/rMFMfN2/npkh4X3j7Ak4lcCS9t0w==',key_name='tempest-keypair-204708746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-30sp9xr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=4a970e43-ae6e-46fc-a5e7-173012590ca7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a970e43-ae6e-46fc-a5e7-173012590ca7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:28:34 user nova-compute[74048]:   <uuid>4a970e43-ae6e-46fc-a5e7-173012590ca7</uuid>
Oct 25 16:28:34 user nova-compute[74048]:   <name>instance-0000000c</name>
Oct 25 16:28:34 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:28:34 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:28:34 user nova-compute[74048]:   <metadata>
Oct 25 16:28:34 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:28:34 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:28:34 user nova-compute[74048]:       <nova:name>tempest-tempest.common.compute-instance-2127080201</nova:name>
Oct 25 16:28:34 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:28:34</nova:creationTime>
Oct 25 16:28:34 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:28:34 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:28:34 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:28:34 user nova-compute[74048]:       <nova:owner>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:user uuid="c809d630a78d4ce4bef9a9462543d2ad">tempest-ServerActionsTestOtherA-318048713-project-member</nova:user>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:project uuid="8ad2347aaae1424681b490608fde8b08">tempest-ServerActionsTestOtherA-318048713</nova:project>
Oct 25 16:28:34 user nova-compute[74048]:       </nova:owner>
Oct 25 16:28:34 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:28:34 user nova-compute[74048]:       <nova:ports>
Oct 25 16:28:34 user nova-compute[74048]:         <nova:port uuid="56d3478b-943a-4c3b-9864-0b6e4c519e4a">
Oct 25 16:28:34 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 16:28:34 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:34 user nova-compute[74048]:       </nova:ports>
Oct 25 16:28:34 user nova-compute[74048]:     </nova:instance>
Oct 25 16:28:34 user nova-compute[74048]:   </metadata>
Oct 25 16:28:34 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:28:34 user nova-compute[74048]:     <system>
Oct 25 16:28:34 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:28:34 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:28:34 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:28:34 user nova-compute[74048]:       <entry name="serial">4a970e43-ae6e-46fc-a5e7-173012590ca7</entry>
Oct 25 16:28:34 user nova-compute[74048]:       <entry name="uuid">4a970e43-ae6e-46fc-a5e7-173012590ca7</entry>
Oct 25 16:28:34 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:28:34 user nova-compute[74048]:     </system>
Oct 25 16:28:34 user nova-compute[74048]:   </sysinfo>
Oct 25 16:28:34 user nova-compute[74048]:   <os>
Oct 25 16:28:34 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:28:34 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:28:34 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:28:34 user nova-compute[74048]:   </os>
Oct 25 16:28:34 user nova-compute[74048]:   <features>
Oct 25 16:28:34 user nova-compute[74048]:     <acpi/>
Oct 25 16:28:34 user nova-compute[74048]:     <apic/>
Oct 25 16:28:34 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:28:34 user nova-compute[74048]:   </features>
Oct 25 16:28:34 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:28:34 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:28:34 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:28:34 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:28:34 user nova-compute[74048]:   </clock>
Oct 25 16:28:34 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:28:34 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:28:34 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:28:34 user nova-compute[74048]:   </cpu>
Oct 25 16:28:34 user nova-compute[74048]:   <devices>
Oct 25 16:28:34 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:28:34 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:28:34 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk"/>
Oct 25 16:28:34 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:28:34 user nova-compute[74048]:     </disk>
Oct 25 16:28:34 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:34 user nova-compute[74048]:       <mac address="fa:16:3e:b6:87:5d"/>
Oct 25 16:28:34 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:34 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:34 user nova-compute[74048]:       <target dev="tap56d3478b-94"/>
Oct 25 16:28:34 user nova-compute[74048]:     </interface>
Oct 25 16:28:34 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:28:34 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/console.log" append="off"/>
Oct 25 16:28:34 user nova-compute[74048]:     </serial>
Oct 25 16:28:34 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:28:34 user nova-compute[74048]:     <video>
Oct 25 16:28:34 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:34 user nova-compute[74048]:     </video>
Oct 25 16:28:34 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:28:34 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:28:34 user nova-compute[74048]:     </rng>
Oct 25 16:28:34 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:28:34 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:28:34 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:28:34 user nova-compute[74048]:     </memballoon>
Oct 25 16:28:34 user nova-compute[74048]:   </devices>
Oct 25 16:28:34 user nova-compute[74048]: </domain>
Oct 25 16:28:34 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127080201',display_name='tempest-tempest.common.compute-instance-2127080201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127080201',id=12,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF/Ob8zVZV2VbmuGOLtxWdy/S5pTQppE8p4hDAWaGtFkeEynINdBiyI+HYRih4nviB5WYM5HaOiWdBqdpoYiqM9tKvfSHL3HINtv/rMFMfN2/npkh4X3j7Ak4lcCS9t0w==',key_name='tempest-keypair-204708746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-30sp9xr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=4a970e43-ae6e-46fc-a5e7-173012590ca7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG os_vif [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb36c216-058c-51bc-9669-1ef75b50c129', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56d3478b-94, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56d3478b-94, col_values=(('qos', UUID('b3dff6d0-242e-4a06-a0aa-45d5f92b7866')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56d3478b-94, col_values=(('external_ids', {'iface-id': '56d3478b-943a-4c3b-9864-0b6e4c519e4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:87:5d', 'vm-uuid': '4a970e43-ae6e-46fc-a5e7-173012590ca7'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:35 user nova-compute[74048]: INFO os_vif [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94')
Oct 25 16:28:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No VIF found with MAC fa:16:3e:b6:87:5d, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG nova.network.neutron [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updated VIF entry in instance network info cache for port 56d3478b-943a-4c3b-9864-0b6e4c519e4a. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG nova.network.neutron [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44537285-ceaa-4bb8-9996-b6d48090adfe req-ed81ed50-2778-4204-89d3-d0700fdcf3fc service nova] Releasing lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:28:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:28:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-4a5901bf-60e6-4655-879c-cfdbe1f31df4 req-077b0d82-0052-4864-9133-33c4b6ae5b24 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4a5901bf-60e6-4655-879c-cfdbe1f31df4 req-077b0d82-0052-4864-9133-33c4b6ae5b24 service nova] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4a5901bf-60e6-4655-879c-cfdbe1f31df4 req-077b0d82-0052-4864-9133-33c4b6ae5b24 service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4a5901bf-60e6-4655-879c-cfdbe1f31df4 req-077b0d82-0052-4864-9133-33c4b6ae5b24 service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-4a5901bf-60e6-4655-879c-cfdbe1f31df4 req-077b0d82-0052-4864-9133-33c4b6ae5b24 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] No waiting events found dispatching network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:37 user nova-compute[74048]: WARNING nova.compute.manager [req-4a5901bf-60e6-4655-879c-cfdbe1f31df4 req-077b0d82-0052-4864-9133-33c4b6ae5b24 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received unexpected event network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a for instance with vm_state building and task_state spawning.
Oct 25 16:28:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 is timed out.
Oct 25 16:28:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully detached device vdb from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the live domain config.
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZrCgJOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e1682-e5f5-46a0-8ba8-e2415fe392e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:37 user nova-compute[74048]: No targets found.
Oct 25 16:28:37 user nova-compute[74048]: iSNS:
Oct 25 16:28:37 user nova-compute[74048]: No targets found.
Oct 25 16:28:37 user nova-compute[74048]: STATIC:
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:37 user nova-compute[74048]: No targets found.
Oct 25 16:28:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:37 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:37 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f921c3e-3bf4-40ce-8604-8cf762d51c4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[afae2403-c0c8-4fea-8c16-21ec59300763]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184066fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cbced1-7328-4893-8def-0e9a1924a5ff]: (4, ('path checker states:\nup                  6\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7cf326-2520-4230-bf9e-c2d243ae67a7]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c197f-0888-43a2-a91b-51eee3b6fff2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[074f9c26-0878-4d64-94ed-a71dd1c2fb61]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc865ef-e52b-4772-90f6-1d7468c45e92]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae is timed out.
Oct 25 16:28:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Successfully detached device vdb from instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae from the live domain config.
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFyvEnbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c2ea7c-a2fb-4790-873e-ccb55cd5dd5b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260]
Oct 25 16:28:37 user nova-compute[74048]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb7a031-ac89-4076-88c6-803b96581efc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7544e4e3-c4ba-484a-87c8-59142386e2e0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] <== disconnect_volume: return (429ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.073s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da85b7-e246-49fe-ada1-2892f970d081]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:37 user nova-compute[74048]: No targets found.
Oct 25 16:28:37 user nova-compute[74048]: iSNS:
Oct 25 16:28:37 user nova-compute[74048]: No targets found.
Oct 25 16:28:37 user nova-compute[74048]: STATIC:
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:37 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:37 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:37 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:37 user nova-compute[74048]: No targets found.
Oct 25 16:28:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:37 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:37 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7361b1-733b-4b79-8637-7b9df3603112]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[685b0653-89b8-46cc-99fc-5604e4624b75]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18406c1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d'): ({'sde'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Removing single pathed devices sde {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a8069-a337-4e33-820b-877edde38b56]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3436bd09-601c-4053-a1c5-162d172f2532]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Flushing IO for device /dev/sde {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9ab0f-f45b-4884-a332-b1fc61db407b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99c458b-fdfb-4926-9044-3be61b1dd0fa]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19c143-e0dd-4f82-b9f5-e424d7286a56]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de87b27-59c6-4e28-bef0-1a9eccd7d1c5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260]
Oct 25 16:28:38 user nova-compute[74048]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b965b3a-1b7e-48bd-8c6c-a98f35329e1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bfb9ed-ca1f-4e31-9a12-b2edf9a63f5d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] <== disconnect_volume: return (486ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:38 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15012856-adde-4587-b34e-979a0441bbaf is timed out.
Oct 25 16:28:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Successfully detached device vdb from instance 15012856-adde-4587-b34e-979a0441bbaf from the live domain config.
Oct 25 16:28:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQifvDUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:38 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e48265b-b867-4a42-b354-cc1aa55450e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:38 user nova-compute[74048]: No targets found.
Oct 25 16:28:38 user nova-compute[74048]: iSNS:
Oct 25 16:28:38 user nova-compute[74048]: No targets found.
Oct 25 16:28:38 user nova-compute[74048]: STATIC:
Oct 25 16:28:38 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25
Oct 25 16:28:38 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:38 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:38 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:38 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:38 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:38 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:38 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:38 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:38 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:28:38 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:38 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:38 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:28:38 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:38 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:38 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:38 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:38 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:38 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:38 user nova-compute[74048]: No targets found.
Oct 25 16:28:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:38 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:38 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe658e0-8c6a-4017-b70b-67e9c15aa253]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a361cb8c-0a7c-45ff-82a1-601e22dbf957]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850326710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25'): ({'sdf'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Removing single pathed devices sdf {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:28:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18d1f5c-1e8f-46d9-aaec-203b392bdbb4]: (4, ('path checker states:\nup                  4\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f3f5aa-baf0-4126-95f0-5aa325e01365]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Flushing IO for device /dev/sdf {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5b0ad-534a-4a7e-ad60-2f3a931abd45]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b87b9-965a-4363-828b-74571aa62f31]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[33201a33-026a-4a23-98f5-1ff43f4417b8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a34dffd-3200-4cbe-abbe-e9321d6e7b12]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260]
Oct 25 16:28:39 user nova-compute[74048]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:39 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6593945-4043-4127-a844-a806194eeb25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb9c5a-ce3a-4f1f-b8b1-1ddaaa9e6ce4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] <== disconnect_volume: return (450ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-cce0004b-49b5-4395-9a45-69b771a1ef7e req-51056e57-ed63-4113-9a8a-0609de626c59 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cce0004b-49b5-4395-9a45-69b771a1ef7e req-51056e57-ed63-4113-9a8a-0609de626c59 service nova] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cce0004b-49b5-4395-9a45-69b771a1ef7e req-51056e57-ed63-4113-9a8a-0609de626c59 service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cce0004b-49b5-4395-9a45-69b771a1ef7e req-51056e57-ed63-4113-9a8a-0609de626c59 service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-cce0004b-49b5-4395-9a45-69b771a1ef7e req-51056e57-ed63-4113-9a8a-0609de626c59 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] No waiting events found dispatching network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:39 user nova-compute[74048]: WARNING nova.compute.manager [req-cce0004b-49b5-4395-9a45-69b771a1ef7e req-51056e57-ed63-4113-9a8a-0609de626c59 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received unexpected event network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a for instance with vm_state building and task_state spawning.
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:28:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance spawned successfully.
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:39 user nova-compute[74048]: INFO nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Took 7.08 seconds to spawn the instance on the hypervisor.
Oct 25 16:28:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:28:39 user nova-compute[74048]: INFO nova.compute.manager [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Took 8.16 seconds to build instance.
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1536b2f8-d076-4837-a35c-bd41e0b91e57 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.316s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:40 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ddc67032-ea48-4809-9666-510c7f87f320 is timed out.
Oct 25 16:28:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Successfully detached device sdc from instance ddc67032-ea48-4809-9666-510c7f87f320 from the live domain config.
Oct 25 16:28:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mkaKdcZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:40 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f682f-f013-4eeb-ac10-ef976ec4bf68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:40 user nova-compute[74048]: No targets found.
Oct 25 16:28:40 user nova-compute[74048]: iSNS:
Oct 25 16:28:40 user nova-compute[74048]: No targets found.
Oct 25 16:28:40 user nova-compute[74048]: STATIC:
Oct 25 16:28:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631
Oct 25 16:28:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:28:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:28:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:40 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:40 user nova-compute[74048]: No targets found.
Oct 25 16:28:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:40 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:40 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35068f-186a-49a3-bad4-14c47d6ca9e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd5f14-ba69-481e-ad9a-038d41dbcdaf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185832d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631'): ({'sdg'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Removing single pathed devices sdg {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca34abb-8efd-4071-81c8-6b812c1684af]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ab1358-93a5-45c8-ad87-13d730d1406b]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Flushing IO for device /dev/sdg {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[36871e31-599f-494b-a279-26d845cb1d5c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[051b2feb-9081-4eab-acdc-f3fb5d0f3a4c]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] SCSI volumes sdg have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cce8c8-1db6-46fe-b19b-2b2235007dcc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abf58d-060a-40bf-b418-b7eff08e0ed8]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260]
Oct 25 16:28:40 user nova-compute[74048]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832a7e6-966c-4c50-925a-77e7972b9631 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[774af5c1-b11c-415e-9277-47e62406e930]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] <== disconnect_volume: return (427ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFYtwhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ae1fcb2-fa7f-44f5-8661-1271668567bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'a90a40ec-02fa-434a-8905-17eb88a981a4', 'serial': 'a90a40ec-02fa-434a-8905-17eb88a981a4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '4ae1fcb2-fa7f-44f5-8661-1271668567bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82864e7-21ff-4621-b808-205be1faa6e3', 'serial'} {{(pid=74048) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFYtwhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:40 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:40 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:40 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d865b-7b65-463a-b592-40ccc5eb7e72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:28:40 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c64cd9f-b4c0-4a83-8a02-6b87e4974d97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4] added
Oct 25 16:28:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173a62d-30d2-405c-a28d-f289bda104be]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6356b72-a555-4d93-bc50-061fd99ca19a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWFYtwhv {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yWFYtwhv" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f1506-4e67-4d09-b312-85e02627ea7a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yWFYtwhv'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7792aef-0456-4175-810b-93ad52d5632d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b293b2c-aa22-40fd-89bd-b0ff83aca7a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d115c14-a517-49a0-8110-7f51588784ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260]
Oct 25 16:28:41 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e8c297-3633-4ab4-9b6a-88f9d43f6a8c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e07b8a-854d-4a2c-9479-5bdf73a06764]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.483s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a0390-91ec-423e-a7c9-4870b5ad6f60]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:28:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG nova.objects.instance [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lazy-loading 'flavor' on Instance uuid 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFYtwhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.535s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] <== connect_volume: return (1538ms) {'type': 'block', 'scsi_wwn': '23034623366356137', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034623366356137', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG nova.objects.instance [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lazy-loading 'flavor' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-14e99e8e-69aa-483b-a97b-c208ad259fc3 tempest-VolumesAssistedSnapshotsTest-1775087285 tempest-VolumesAssistedSnapshotsTest-1775087285-project-admin] Lock "15012856-adde-4587-b34e-979a0441bbaf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.410s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 90177536 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lazy-loading 'flavor' on Instance uuid ddc67032-ea48-4809-9666-510c7f87f320 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ea68b4c3-bf6a-45ee-998b-0ba52696cc71 tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.031s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:44 user nova-compute[74048]: INFO nova.compute.manager [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Terminating instance
Oct 25 16:28:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 404750336 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-09b3be8d-b6e5-4672-8c00-016a9877a7c6 req-46fbb376-4a26-406c-a47f-68755d6995e7 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-vif-unplugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-09b3be8d-b6e5-4672-8c00-016a9877a7c6 req-46fbb376-4a26-406c-a47f-68755d6995e7 service nova] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-09b3be8d-b6e5-4672-8c00-016a9877a7c6 req-46fbb376-4a26-406c-a47f-68755d6995e7 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-09b3be8d-b6e5-4672-8c00-016a9877a7c6 req-46fbb376-4a26-406c-a47f-68755d6995e7 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-09b3be8d-b6e5-4672-8c00-016a9877a7c6 req-46fbb376-4a26-406c-a47f-68755d6995e7 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] No waiting events found dispatching network-vif-unplugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-09b3be8d-b6e5-4672-8c00-016a9877a7c6 req-46fbb376-4a26-406c-a47f-68755d6995e7 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-vif-unplugged-c5649328-cbf9-459d-9a05-de071a78fc14 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 888143872 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Instance destroyed successfully.
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lazy-loading 'resources' on Instance uuid ddc67032-ea48-4809-9666-510c7f87f320 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:46 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:46 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7778MB free_disk=25.609962463378906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1200770277',display_name='tempest-AttachSCSIVolumeTestJSON-server-1200770277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1200770277',id=7,image_ref='6c645f1f-7a81-48fd-8107-7eeb60d46a52',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbuxxpsUbCtmo9fboY8JrJ6ox1mlp6Z899bPyn7rDWqnkZ8npgWTcfI/tx3zGEIS+pWBl3bWKjkcwIPMNhoUt5+ZL1zaFA3Odw2INn42elHVYsl51Nrj9iKGwKPd+qfWA==',key_name='tempest-keypair-9011675',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f3896af58054c3a9efa35f9502c8401',ramdisk_id='',reservation_id='r-wtwo19ms',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c645f1f-7a81-48fd-8107-7eeb60d46a52',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1025055638',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1025055638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1b0e48155e4cb5b525d5366f59a963',uuid=ddc67032-ea48-4809-9666-510c7f87f320,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Converting VIF {"id": "c5649328-cbf9-459d-9a05-de071a78fc14", "address": "fa:16:3e:cc:0e:d6", "network": {"id": "8cda4da6-1de9-450c-bc96-55cc81b979b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1991567123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f3896af58054c3a9efa35f9502c8401", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5649328-cb", "ovs_interfaceid": "c5649328-cbf9-459d-9a05-de071a78fc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG os_vif [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5649328-cb, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2c28da8-3c2f-4fc4-870d-9784f1aa8ae2) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:46 user nova-compute[74048]: INFO os_vif [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:0e:d6,bridge_name='br-int',has_traffic_filtering=True,id=c5649328-cbf9-459d-9a05-de071a78fc14,network=Network(8cda4da6-1de9-450c-bc96-55cc81b979b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5649328-cb')
Oct 25 16:28:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Deleting instance files /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320_del
Oct 25 16:28:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Deletion of /opt/stack/data/nova/instances/ddc67032-ea48-4809-9666-510c7f87f320_del complete
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ddc67032-ea48-4809-9666-510c7f87f320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 15012856-adde-4587-b34e-979a0441bbaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 62102eec-d6bd-45d2-a45e-bd90278a34a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4a970e43-ae6e-46fc-a5e7-173012590ca7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:28:46 user nova-compute[74048]: INFO nova.compute.manager [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Took 2.10 seconds to destroy the instance on the hypervisor.
Oct 25 16:28:46 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: ddc67032-ea48-4809-9666-510c7f87f320] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:28:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 988807168 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-f97b2fb9-b620-4da0-8d16-6134a2f5321d req-9a1d4955-e5bc-44cf-8d51-1e6763613716 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f97b2fb9-b620-4da0-8d16-6134a2f5321d req-9a1d4955-e5bc-44cf-8d51-1e6763613716 service nova] Acquiring lock "ddc67032-ea48-4809-9666-510c7f87f320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f97b2fb9-b620-4da0-8d16-6134a2f5321d req-9a1d4955-e5bc-44cf-8d51-1e6763613716 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f97b2fb9-b620-4da0-8d16-6134a2f5321d req-9a1d4955-e5bc-44cf-8d51-1e6763613716 service nova] Lock "ddc67032-ea48-4809-9666-510c7f87f320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-f97b2fb9-b620-4da0-8d16-6134a2f5321d req-9a1d4955-e5bc-44cf-8d51-1e6763613716 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] No waiting events found dispatching network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:47 user nova-compute[74048]: WARNING nova.compute.manager [req-f97b2fb9-b620-4da0-8d16-6134a2f5321d req-9a1d4955-e5bc-44cf-8d51-1e6763613716 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received unexpected event network-vif-plugged-c5649328-cbf9-459d-9a05-de071a78fc14 for instance with vm_state active and task_state deleting.
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.041s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:47 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e536b8-299b-4e27-ae67-6eb28112c52d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:28:47 user nova-compute[74048]: No targets found.
Oct 25 16:28:47 user nova-compute[74048]: iSNS:
Oct 25 16:28:47 user nova-compute[74048]: No targets found.
Oct 25 16:28:47 user nova-compute[74048]: STATIC:
Oct 25 16:28:47 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:28:47 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:47 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:47 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4
Oct 25 16:28:47 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:47 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:47 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:28:47 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:47 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:47 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:28:47 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:47 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:47 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:47 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:28:47 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:28:47 user nova-compute[74048]: FIRMWARE:
Oct 25 16:28:47 user nova-compute[74048]: No targets found.
Oct 25 16:28:47 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:28:47 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:28:47 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[168543ff-53a8-4ad6-9d32-16dda0bc4b99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cad23d-13d1-43d5-b9bb-9db098615b00]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:28:47 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1858159870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3'): ({'sdd'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Removing single pathed devices sdd {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d03f4-3962-4619-b86b-b5a96b07f33a]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eaf6d8-f632-4227-9225-0efd80945d05]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Flushing IO for device /dev/sdd {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7cfe4d-d353-46b4-9d83-7627391f9ebb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e0bc6-f05c-4b7e-885f-afb7ac7af522]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6c87e8-1cdf-4479-987e-a5997ef2ca85]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1747e6-6753-4abd-9cb6-edf83fd2dcef]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]
Oct 25 16:28:47 user nova-compute[74048]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.
Oct 25 16:28:47 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd8fb2b-9288-473f-8b2a-7ffa0f9308c9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] <== disconnect_volume: return (397ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFYtwhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4ae1fcb2-fa7f-44f5-8661-1271668567bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'a90a40ec-02fa-434a-8905-17eb88a981a4', 'serial'} {{(pid=74048) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] swap_volume: removing Cinder connection for volume d82864e7-21ff-4621-b808-205be1faa6e3 {{(pid=74048) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'flavor' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:28:48 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Took 1.60 seconds to deallocate network for instance.
Oct 25 16:28:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4e0b3932-a147-4681-ad0c-1a3e2aaad029 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.172s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "interface-25e59513-b3bb-44c2-ac27-f9dcdacffed1-a03d1557-3c0c-4b3d-922e-e62c83fadcd3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "interface-25e59513-b3bb-44c2-ac27-f9dcdacffed1-a03d1557-3c0c-4b3d-922e-e62c83fadcd3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'flavor' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface> {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface> {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Attempting to detach device tapa03d1557-3c from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] detach device xml: <interface type="ethernet">
Oct 25 16:28:48 user nova-compute[74048]:   <mac address="fa:16:3e:9d:a0:88"/>
Oct 25 16:28:48 user nova-compute[74048]:   <model type="virtio"/>
Oct 25 16:28:48 user nova-compute[74048]:   <mtu size="1442"/>
Oct 25 16:28:48 user nova-compute[74048]:   <target dev="tapa03d1557-3c"/>
Oct 25 16:28:48 user nova-compute[74048]: </interface>
Oct 25 16:28:48 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface> {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 25 16:28:48 user nova-compute[74048]:   <name>instance-00000005</name>
Oct 25 16:28:48 user nova-compute[74048]:   <uuid>25e59513-b3bb-44c2-ac27-f9dcdacffed1</uuid>
Oct 25 16:28:48 user nova-compute[74048]:   <metadata>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:28:48 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:28:48 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:28:48 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:26:57</nova:creationTime>
Oct 25 16:28:48 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:28:48 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:28:48 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:28:48 user nova-compute[74048]:   <nova:owner>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:28:48 user nova-compute[74048]:   </nova:owner>
Oct 25 16:28:48 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:28:48 user nova-compute[74048]:   <nova:ports>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:28:48 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:28:48 user nova-compute[74048]:     </nova:port>
Oct 25 16:28:48 user nova-compute[74048]:     <nova:port uuid="a03d1557-3c0c-4b3d-922e-e62c83fadcd3">
Oct 25 16:28:48 user nova-compute[74048]:       <nova:ip type="fixed" address="10.10.10.234" ipVersion="4"/>
Oct 25 16:28:48 user nova-compute[74048]:     </nova:port>
Oct 25 16:28:48 user nova-compute[74048]:   </nova:ports>
Oct 25 16:28:48 user nova-compute[74048]: </nova:instance>
Oct 25 16:28:48 user nova-compute[74048]:   </metadata>
Oct 25 16:28:48 user nova-compute[74048]:   <memory unit='KiB'>524288</memory>
Oct 25 16:28:48 user nova-compute[74048]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 16:28:48 user nova-compute[74048]:   <vcpu placement='static'>1</vcpu>
Oct 25 16:28:48 user nova-compute[74048]:   <resource>
Oct 25 16:28:48 user nova-compute[74048]:     <partition>/machine</partition>
Oct 25 16:28:48 user nova-compute[74048]:   </resource>
Oct 25 16:28:48 user nova-compute[74048]:   <sysinfo type='smbios'>
Oct 25 16:28:48 user nova-compute[74048]:     <system>
Oct 25 16:28:48 user nova-compute[74048]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 16:28:48 user nova-compute[74048]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 16:28:48 user nova-compute[74048]:       <entry name='version'>0.0.0</entry>
Oct 25 16:28:48 user nova-compute[74048]:       <entry name='serial'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:28:48 user nova-compute[74048]:       <entry name='uuid'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:28:48 user nova-compute[74048]:       <entry name='family'>Virtual Machine</entry>
Oct 25 16:28:48 user nova-compute[74048]:     </system>
Oct 25 16:28:48 user nova-compute[74048]:   </sysinfo>
Oct 25 16:28:48 user nova-compute[74048]:   <os>
Oct 25 16:28:48 user nova-compute[74048]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 16:28:48 user nova-compute[74048]:     <boot dev='hd'/>
Oct 25 16:28:48 user nova-compute[74048]:     <smbios mode='sysinfo'/>
Oct 25 16:28:48 user nova-compute[74048]:   </os>
Oct 25 16:28:48 user nova-compute[74048]:   <features>
Oct 25 16:28:48 user nova-compute[74048]:     <acpi/>
Oct 25 16:28:48 user nova-compute[74048]:     <apic/>
Oct 25 16:28:48 user nova-compute[74048]:     <vmcoreinfo state='on'/>
Oct 25 16:28:48 user nova-compute[74048]:   </features>
Oct 25 16:28:48 user nova-compute[74048]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 16:28:48 user nova-compute[74048]:     <model fallback='forbid'>Nehalem</model>
Oct 25 16:28:48 user nova-compute[74048]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 16:28:48 user nova-compute[74048]:     <feature policy='require' name='vme'/>
Oct 25 16:28:48 user nova-compute[74048]:     <feature policy='require' name='x2apic'/>
Oct 25 16:28:48 user nova-compute[74048]:     <feature policy='require' name='hypervisor'/>
Oct 25 16:28:48 user nova-compute[74048]:   </cpu>
Oct 25 16:28:48 user nova-compute[74048]:   <clock offset='utc'>
Oct 25 16:28:48 user nova-compute[74048]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 16:28:48 user nova-compute[74048]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 16:28:48 user nova-compute[74048]:     <timer name='hpet' present='no'/>
Oct 25 16:28:48 user nova-compute[74048]:   </clock>
Oct 25 16:28:48 user nova-compute[74048]:   <on_poweroff>destroy</on_poweroff>
Oct 25 16:28:48 user nova-compute[74048]:   <on_reboot>restart</on_reboot>
Oct 25 16:28:48 user nova-compute[74048]:   <on_crash>destroy</on_crash>
Oct 25 16:28:48 user nova-compute[74048]:   <devices>
Oct 25 16:28:48 user nova-compute[74048]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 16:28:48 user nova-compute[74048]:     <disk type='file' device='disk'>
Oct 25 16:28:48 user nova-compute[74048]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 16:28:48 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk' index='2'/>
Oct 25 16:28:48 user nova-compute[74048]:       <backingStore type='file' index='3'>
Oct 25 16:28:48 user nova-compute[74048]:         <format type='raw'/>
Oct 25 16:28:48 user nova-compute[74048]:         <source file='/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7'/>
Oct 25 16:28:48 user nova-compute[74048]:         <backingStore/>
Oct 25 16:28:48 user nova-compute[74048]:       </backingStore>
Oct 25 16:28:48 user nova-compute[74048]:       <target dev='vda' bus='virtio'/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='virtio-disk0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </disk>
Oct 25 16:28:48 user nova-compute[74048]:     <disk type='file' device='cdrom'>
Oct 25 16:28:48 user nova-compute[74048]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 16:28:48 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config' index='1'/>
Oct 25 16:28:48 user nova-compute[74048]:       <backingStore/>
Oct 25 16:28:48 user nova-compute[74048]:       <target dev='hda' bus='ide'/>
Oct 25 16:28:48 user nova-compute[74048]:       <readonly/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='ide0-0-0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </disk>
Oct 25 16:28:48 user nova-compute[74048]:     <controller type='usb' index='0' model='none'>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='usb'/>
Oct 25 16:28:48 user nova-compute[74048]:     </controller>
Oct 25 16:28:48 user nova-compute[74048]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='pci.0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </controller>
Oct 25 16:28:48 user nova-compute[74048]:     <controller type='ide' index='0'>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='ide'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 16:28:48 user nova-compute[74048]:     </controller>
Oct 25 16:28:48 user nova-compute[74048]:     <interface type='ethernet'>
Oct 25 16:28:48 user nova-compute[74048]:       <mac address='fa:16:3e:96:f9:76'/>
Oct 25 16:28:48 user nova-compute[74048]:       <target dev='tap0334d634-48'/>
Oct 25 16:28:48 user nova-compute[74048]:       <model type='virtio'/>
Oct 25 16:28:48 user nova-compute[74048]:       <mtu size='1442'/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='net0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </interface>
Oct 25 16:28:48 user nova-compute[74048]:     <interface type='ethernet'>
Oct 25 16:28:48 user nova-compute[74048]:       <mac address='fa:16:3e:9d:a0:88'/>
Oct 25 16:28:48 user nova-compute[74048]:       <target dev='tapa03d1557-3c'/>
Oct 25 16:28:48 user nova-compute[74048]:       <model type='virtio'/>
Oct 25 16:28:48 user nova-compute[74048]:       <mtu size='1442'/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='net1'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </interface>
Oct 25 16:28:48 user nova-compute[74048]:     <serial type='pty'>
Oct 25 16:28:48 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:28:48 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:28:48 user nova-compute[74048]:       <target type='isa-serial' port='0'>
Oct 25 16:28:48 user nova-compute[74048]:         <model name='isa-serial'/>
Oct 25 16:28:48 user nova-compute[74048]:       </target>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </serial>
Oct 25 16:28:48 user nova-compute[74048]:     <console type='pty' tty='/dev/pts/4'>
Oct 25 16:28:48 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:28:48 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:28:48 user nova-compute[74048]:       <target type='serial' port='0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </console>
Oct 25 16:28:48 user nova-compute[74048]:     <input type='mouse' bus='ps2'>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='input0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </input>
Oct 25 16:28:48 user nova-compute[74048]:     <input type='keyboard' bus='ps2'>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='input1'/>
Oct 25 16:28:48 user nova-compute[74048]:     </input>
Oct 25 16:28:48 user nova-compute[74048]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 25 16:28:48 user nova-compute[74048]:       <listen type='address' address='0.0.0.0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </graphics>
Oct 25 16:28:48 user nova-compute[74048]:     <audio id='1' type='none'/>
Oct 25 16:28:48 user nova-compute[74048]:     <video>
Oct 25 16:28:48 user nova-compute[74048]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='video0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </video>
Oct 25 16:28:48 user nova-compute[74048]:     <memballoon model='virtio'>
Oct 25 16:28:48 user nova-compute[74048]:       <stats period='10'/>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='balloon0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </memballoon>
Oct 25 16:28:48 user nova-compute[74048]:     <rng model='virtio'>
Oct 25 16:28:48 user nova-compute[74048]:       <backend model='random'>/dev/urandom</backend>
Oct 25 16:28:48 user nova-compute[74048]:       <alias name='rng0'/>
Oct 25 16:28:48 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 16:28:48 user nova-compute[74048]:     </rng>
Oct 25 16:28:48 user nova-compute[74048]:   </devices>
Oct 25 16:28:48 user nova-compute[74048]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 16:28:48 user nova-compute[74048]:     <label>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</label>
Oct 25 16:28:48 user nova-compute[74048]:     <imagelabel>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</imagelabel>
Oct 25 16:28:48 user nova-compute[74048]:   </seclabel>
Oct 25 16:28:48 user nova-compute[74048]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 16:28:48 user nova-compute[74048]:     <label>+64055:+108</label>
Oct 25 16:28:48 user nova-compute[74048]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 16:28:48 user nova-compute[74048]:   </seclabel>
Oct 25 16:28:48 user nova-compute[74048]: </domain>
Oct 25 16:28:48 user nova-compute[74048]:  {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 16:28:48 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully detached device tapa03d1557-3c from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the persistent domain config.
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] (1/8): Attempting to detach device tapa03d1557-3c with device alias net1 from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] detach device xml: <interface type="ethernet">
Oct 25 16:28:48 user nova-compute[74048]:   <mac address="fa:16:3e:9d:a0:88"/>
Oct 25 16:28:48 user nova-compute[74048]:   <model type="virtio"/>
Oct 25 16:28:48 user nova-compute[74048]:   <mtu size="1442"/>
Oct 25 16:28:48 user nova-compute[74048]:   <target dev="tapa03d1557-3c"/>
Oct 25 16:28:48 user nova-compute[74048]: </interface>
Oct 25 16:28:48 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Start waiting for the detach event from libvirt for device tapa03d1557-3c with device alias net1 for instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:49 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Deleted allocations for instance ddc67032-ea48-4809-9666-510c7f87f320
Oct 25 16:28:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-a6bab7ac-4b43-493c-a09e-9957a12e59d2 req-1466ee72-b16d-460d-9515-fe1fcc0a6eb7 service nova] [instance: ddc67032-ea48-4809-9666-510c7f87f320] Received event network-vif-deleted-c5649328-cbf9-459d-9a05-de071a78fc14 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-88099687-05af-4fc7-a547-aae472f90c2c tempest-AttachSCSIVolumeTestJSON-1025055638 tempest-AttachSCSIVolumeTestJSON-1025055638-project-member] Lock "ddc67032-ea48-4809-9666-510c7f87f320" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.728s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] swap_volume: Updating volume d82864e7-21ff-4621-b808-205be1faa6e3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yWFYtwhv", "auth_password": "Esc9bxUFa12npO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "a90a40ec-02fa-434a-8905-17eb88a981a4"}, "status": "reserved", "instance": "4ae1fcb2-fa7f-44f5-8661-1271668567bd", "attached_at": "", "detached_at": "", "volume_id": "a90a40ec-02fa-434a-8905-17eb88a981a4", "serial": "a90a40ec-02fa-434a-8905-17eb88a981a4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a90a40ec-02fa-434a-8905-17eb88a981a4', 'no_device': None, 'attachment_id': 'db851833-f627-4994-9fd4-a63cdbdc42e1'} {{(pid=74048) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dcfb7197-6b4f-440e-9cc5-682437775854 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.732s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:28:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:50 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:28:50 user nova-compute[74048]: INFO nova.compute.claims [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Claim successful on node user
Oct 25 16:28:50 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:28:50 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.954s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-unplugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-unplugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:51 user nova-compute[74048]: WARNING nova.compute.manager [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-unplugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 for instance with vm_state active and task_state None.
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:51 user nova-compute[74048]: WARNING nova.compute.manager [req-aec9209d-b37f-4e36-a636-57652e4fdf99 req-cbf3d598-6d0d-40c9-b114-b36f3478c06e service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-plugged-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 for instance with vm_state active and task_state None.
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:28:51 user nova-compute[74048]: DEBUG os_brick.utils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3faf8f-a110-4ec0-8ee2-b305cc7396a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6bebd8-9f5e-465d-96b5-9610203f030d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac95439d-7d4b-4d91-ad2c-0d1b8f03f36b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e61882-9fc8-4f47-a13c-35eab1dece85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.policy [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c18414d5c9d7450ca96521eabe2a002d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add2dbb4f18f41b291725ab0073ebd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:28:51 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4720936-7f0c-4473-98ed-d5004d26a24b]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG os_brick.utils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:28:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Creating image(s)
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "/opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "/opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "/opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:51 user nova-compute[74048]: INFO nova.compute.manager [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Swapping volume a90a40ec-02fa-434a-8905-17eb88a981a4 for d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.228s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk 1073741824" returned: 0 in 0.055s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Successfully created port: e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Cannot resize image /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Ensure instance console log exists: /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Successfully updated port: e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquired lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-changed-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Refreshing instance network info cache due to event network-changed-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] Acquiring lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updating instance_info_cache with network_info: [{"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Releasing lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Instance network_info: |[{"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] Acquired lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Refreshing network info cache for port e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Start _get_guest_xml network_info=[{"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:28:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-283217924',display_name='tempest-AttachVolumeNegativeTest-server-283217924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-283217924',id=13,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe9bom7TnMW7eu+3LPUqovy61OgYWGU8jMbX0FPpdwRkECh9GL3sQzHS0PImPMBg8ltYOZwPxCl0aMyL64RVD8uLAl1K6YP45lbUekoryResqkoYySsCCUUKjppLq0MQ==',key_name='tempest-keypair-390159991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-al3gtjxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=99762562-1e2b-4518-b61c-0acb35949522,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'pci_devices' on Instance uuid 99762562-1e2b-4518-b61c-0acb35949522 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:28:53 user nova-compute[74048]:   <uuid>99762562-1e2b-4518-b61c-0acb35949522</uuid>
Oct 25 16:28:53 user nova-compute[74048]:   <name>instance-0000000d</name>
Oct 25 16:28:53 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:28:53 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:28:53 user nova-compute[74048]:   <metadata>
Oct 25 16:28:53 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:28:53 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:28:53 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeNegativeTest-server-283217924</nova:name>
Oct 25 16:28:53 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:28:53</nova:creationTime>
Oct 25 16:28:53 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:28:53 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:28:53 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:28:53 user nova-compute[74048]:       <nova:owner>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:user uuid="c18414d5c9d7450ca96521eabe2a002d">tempest-AttachVolumeNegativeTest-1660122620-project-member</nova:user>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:project uuid="add2dbb4f18f41b291725ab0073ebd37">tempest-AttachVolumeNegativeTest-1660122620</nova:project>
Oct 25 16:28:53 user nova-compute[74048]:       </nova:owner>
Oct 25 16:28:53 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:28:53 user nova-compute[74048]:       <nova:ports>
Oct 25 16:28:53 user nova-compute[74048]:         <nova:port uuid="e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1">
Oct 25 16:28:53 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 16:28:53 user nova-compute[74048]:         </nova:port>
Oct 25 16:28:53 user nova-compute[74048]:       </nova:ports>
Oct 25 16:28:53 user nova-compute[74048]:     </nova:instance>
Oct 25 16:28:53 user nova-compute[74048]:   </metadata>
Oct 25 16:28:53 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:28:53 user nova-compute[74048]:     <system>
Oct 25 16:28:53 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:28:53 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:28:53 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:28:53 user nova-compute[74048]:       <entry name="serial">99762562-1e2b-4518-b61c-0acb35949522</entry>
Oct 25 16:28:53 user nova-compute[74048]:       <entry name="uuid">99762562-1e2b-4518-b61c-0acb35949522</entry>
Oct 25 16:28:53 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:28:53 user nova-compute[74048]:     </system>
Oct 25 16:28:53 user nova-compute[74048]:   </sysinfo>
Oct 25 16:28:53 user nova-compute[74048]:   <os>
Oct 25 16:28:53 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:28:53 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:28:53 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:28:53 user nova-compute[74048]:   </os>
Oct 25 16:28:53 user nova-compute[74048]:   <features>
Oct 25 16:28:53 user nova-compute[74048]:     <acpi/>
Oct 25 16:28:53 user nova-compute[74048]:     <apic/>
Oct 25 16:28:53 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:28:53 user nova-compute[74048]:   </features>
Oct 25 16:28:53 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:28:53 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:28:53 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:28:53 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:28:53 user nova-compute[74048]:   </clock>
Oct 25 16:28:53 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:28:53 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:28:53 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:28:53 user nova-compute[74048]:   </cpu>
Oct 25 16:28:53 user nova-compute[74048]:   <devices>
Oct 25 16:28:53 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:28:53 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:28:53 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk"/>
Oct 25 16:28:53 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:28:53 user nova-compute[74048]:     </disk>
Oct 25 16:28:53 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:28:53 user nova-compute[74048]:       <mac address="fa:16:3e:3c:86:f3"/>
Oct 25 16:28:53 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:53 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:28:53 user nova-compute[74048]:       <target dev="tape2d524b5-63"/>
Oct 25 16:28:53 user nova-compute[74048]:     </interface>
Oct 25 16:28:53 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:28:53 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/console.log" append="off"/>
Oct 25 16:28:53 user nova-compute[74048]:     </serial>
Oct 25 16:28:53 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:28:53 user nova-compute[74048]:     <video>
Oct 25 16:28:53 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:28:53 user nova-compute[74048]:     </video>
Oct 25 16:28:53 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:28:53 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:28:53 user nova-compute[74048]:     </rng>
Oct 25 16:28:53 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:28:53 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:28:53 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:28:53 user nova-compute[74048]:     </memballoon>
Oct 25 16:28:53 user nova-compute[74048]:   </devices>
Oct 25 16:28:53 user nova-compute[74048]: </domain>
Oct 25 16:28:53 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-283217924',display_name='tempest-AttachVolumeNegativeTest-server-283217924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-283217924',id=13,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe9bom7TnMW7eu+3LPUqovy61OgYWGU8jMbX0FPpdwRkECh9GL3sQzHS0PImPMBg8ltYOZwPxCl0aMyL64RVD8uLAl1K6YP45lbUekoryResqkoYySsCCUUKjppLq0MQ==',key_name='tempest-keypair-390159991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-al3gtjxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=99762562-1e2b-4518-b61c-0acb35949522,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG os_vif [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64fd8976-1769-5b5a-a8f5-1f94c7bd44d2', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2d524b5-63, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2d524b5-63, col_values=(('qos', UUID('a6a31c7a-0b30-433e-ac24-90fd1a59b7b3')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2d524b5-63, col_values=(('external_ids', {'iface-id': 'e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:86:f3', 'vm-uuid': '99762562-1e2b-4518-b61c-0acb35949522'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:28:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:53 user nova-compute[74048]: INFO os_vif [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63')
Oct 25 16:28:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:28:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No VIF found with MAC fa:16:3e:3c:86:f3, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:28:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updated VIF entry in instance network info cache for port e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:28:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updating instance_info_cache with network_info: [{"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:28:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bd893e57-3396-46de-b38b-6f8582b2e8db req-6a7795c7-83eb-4b0f-863f-7bd6b3dcfec2 service nova] Releasing lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:28:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-c85fff65-aa2a-4bfb-af3a-c3f995174b0d req-6fe152ac-8905-4a22-a8b9-b600ef6ecfd2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c85fff65-aa2a-4bfb-af3a-c3f995174b0d req-6fe152ac-8905-4a22-a8b9-b600ef6ecfd2 service nova] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c85fff65-aa2a-4bfb-af3a-c3f995174b0d req-6fe152ac-8905-4a22-a8b9-b600ef6ecfd2 service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c85fff65-aa2a-4bfb-af3a-c3f995174b0d req-6fe152ac-8905-4a22-a8b9-b600ef6ecfd2 service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-c85fff65-aa2a-4bfb-af3a-c3f995174b0d req-6fe152ac-8905-4a22-a8b9-b600ef6ecfd2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] No waiting events found dispatching network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:55 user nova-compute[74048]: WARNING nova.compute.manager [req-c85fff65-aa2a-4bfb-af3a-c3f995174b0d req-6fe152ac-8905-4a22-a8b9-b600ef6ecfd2 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received unexpected event network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 for instance with vm_state building and task_state spawning.
Oct 25 16:28:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-890ca525-7b1d-4faf-acc3-a97baf49b0fa req-14cb884b-a201-462c-8e20-dee4957bf956 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-890ca525-7b1d-4faf-acc3-a97baf49b0fa req-14cb884b-a201-462c-8e20-dee4957bf956 service nova] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-890ca525-7b1d-4faf-acc3-a97baf49b0fa req-14cb884b-a201-462c-8e20-dee4957bf956 service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-890ca525-7b1d-4faf-acc3-a97baf49b0fa req-14cb884b-a201-462c-8e20-dee4957bf956 service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-890ca525-7b1d-4faf-acc3-a97baf49b0fa req-14cb884b-a201-462c-8e20-dee4957bf956 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] No waiting events found dispatching network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:28:57 user nova-compute[74048]: WARNING nova.compute.manager [req-890ca525-7b1d-4faf-acc3-a97baf49b0fa req-14cb884b-a201-462c-8e20-dee4957bf956 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received unexpected event network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 for instance with vm_state building and task_state spawning.
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:28:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Instance spawned successfully.
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:28:57 user nova-compute[74048]: INFO nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 25 16:28:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:28:58 user nova-compute[74048]: INFO nova.compute.manager [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Took 7.96 seconds to build instance.
Oct 25 16:28:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e88533-de51-428b-95fc-2d9a8348f648 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.243s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:28:59 user nova-compute[74048]: DEBUG nova.objects.instance [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'flavor' on Instance uuid bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:28:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-660ed04e-3119-4098-a37b-ca07837ebab1 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 42.525s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:28:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:29:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:08 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:29:08 user nova-compute[74048]: INFO nova.compute.claims [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Claim successful on node user
Oct 25 16:29:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Waiting for libvirt event about the detach of device tapa03d1557-3c with device alias net1 from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 is timed out.
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface> {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 25 16:29:09 user nova-compute[74048]:   <name>instance-00000005</name>
Oct 25 16:29:09 user nova-compute[74048]:   <uuid>25e59513-b3bb-44c2-ac27-f9dcdacffed1</uuid>
Oct 25 16:29:09 user nova-compute[74048]:   <metadata>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:09 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:26:57</nova:creationTime>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:29:09 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:09 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:owner>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:29:09 user nova-compute[74048]:   </nova:owner>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:ports>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:29:09 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:29:09 user nova-compute[74048]:     </nova:port>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:port uuid="a03d1557-3c0c-4b3d-922e-e62c83fadcd3">
Oct 25 16:29:09 user nova-compute[74048]:       <nova:ip type="fixed" address="10.10.10.234" ipVersion="4"/>
Oct 25 16:29:09 user nova-compute[74048]:     </nova:port>
Oct 25 16:29:09 user nova-compute[74048]:   </nova:ports>
Oct 25 16:29:09 user nova-compute[74048]: </nova:instance>
Oct 25 16:29:09 user nova-compute[74048]:   </metadata>
Oct 25 16:29:09 user nova-compute[74048]:   <memory unit='KiB'>524288</memory>
Oct 25 16:29:09 user nova-compute[74048]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 16:29:09 user nova-compute[74048]:   <vcpu placement='static'>1</vcpu>
Oct 25 16:29:09 user nova-compute[74048]:   <resource>
Oct 25 16:29:09 user nova-compute[74048]:     <partition>/machine</partition>
Oct 25 16:29:09 user nova-compute[74048]:   </resource>
Oct 25 16:29:09 user nova-compute[74048]:   <sysinfo type='smbios'>
Oct 25 16:29:09 user nova-compute[74048]:     <system>
Oct 25 16:29:09 user nova-compute[74048]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 16:29:09 user nova-compute[74048]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 16:29:09 user nova-compute[74048]:       <entry name='version'>0.0.0</entry>
Oct 25 16:29:09 user nova-compute[74048]:       <entry name='serial'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:29:09 user nova-compute[74048]:       <entry name='uuid'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:29:09 user nova-compute[74048]:       <entry name='family'>Virtual Machine</entry>
Oct 25 16:29:09 user nova-compute[74048]:     </system>
Oct 25 16:29:09 user nova-compute[74048]:   </sysinfo>
Oct 25 16:29:09 user nova-compute[74048]:   <os>
Oct 25 16:29:09 user nova-compute[74048]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 16:29:09 user nova-compute[74048]:     <boot dev='hd'/>
Oct 25 16:29:09 user nova-compute[74048]:     <smbios mode='sysinfo'/>
Oct 25 16:29:09 user nova-compute[74048]:   </os>
Oct 25 16:29:09 user nova-compute[74048]:   <features>
Oct 25 16:29:09 user nova-compute[74048]:     <acpi/>
Oct 25 16:29:09 user nova-compute[74048]:     <apic/>
Oct 25 16:29:09 user nova-compute[74048]:     <vmcoreinfo state='on'/>
Oct 25 16:29:09 user nova-compute[74048]:   </features>
Oct 25 16:29:09 user nova-compute[74048]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 16:29:09 user nova-compute[74048]:     <model fallback='forbid'>Nehalem</model>
Oct 25 16:29:09 user nova-compute[74048]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 16:29:09 user nova-compute[74048]:     <feature policy='require' name='vme'/>
Oct 25 16:29:09 user nova-compute[74048]:     <feature policy='require' name='x2apic'/>
Oct 25 16:29:09 user nova-compute[74048]:     <feature policy='require' name='hypervisor'/>
Oct 25 16:29:09 user nova-compute[74048]:   </cpu>
Oct 25 16:29:09 user nova-compute[74048]:   <clock offset='utc'>
Oct 25 16:29:09 user nova-compute[74048]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 16:29:09 user nova-compute[74048]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 16:29:09 user nova-compute[74048]:     <timer name='hpet' present='no'/>
Oct 25 16:29:09 user nova-compute[74048]:   </clock>
Oct 25 16:29:09 user nova-compute[74048]:   <on_poweroff>destroy</on_poweroff>
Oct 25 16:29:09 user nova-compute[74048]:   <on_reboot>restart</on_reboot>
Oct 25 16:29:09 user nova-compute[74048]:   <on_crash>destroy</on_crash>
Oct 25 16:29:09 user nova-compute[74048]:   <devices>
Oct 25 16:29:09 user nova-compute[74048]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 16:29:09 user nova-compute[74048]:     <disk type='file' device='disk'>
Oct 25 16:29:09 user nova-compute[74048]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 16:29:09 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk' index='2'/>
Oct 25 16:29:09 user nova-compute[74048]:       <backingStore type='file' index='3'>
Oct 25 16:29:09 user nova-compute[74048]:         <format type='raw'/>
Oct 25 16:29:09 user nova-compute[74048]:         <source file='/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7'/>
Oct 25 16:29:09 user nova-compute[74048]:         <backingStore/>
Oct 25 16:29:09 user nova-compute[74048]:       </backingStore>
Oct 25 16:29:09 user nova-compute[74048]:       <target dev='vda' bus='virtio'/>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='virtio-disk0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </disk>
Oct 25 16:29:09 user nova-compute[74048]:     <disk type='file' device='cdrom'>
Oct 25 16:29:09 user nova-compute[74048]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 16:29:09 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config' index='1'/>
Oct 25 16:29:09 user nova-compute[74048]:       <backingStore/>
Oct 25 16:29:09 user nova-compute[74048]:       <target dev='hda' bus='ide'/>
Oct 25 16:29:09 user nova-compute[74048]:       <readonly/>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='ide0-0-0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </disk>
Oct 25 16:29:09 user nova-compute[74048]:     <controller type='usb' index='0' model='none'>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='usb'/>
Oct 25 16:29:09 user nova-compute[74048]:     </controller>
Oct 25 16:29:09 user nova-compute[74048]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='pci.0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </controller>
Oct 25 16:29:09 user nova-compute[74048]:     <controller type='ide' index='0'>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='ide'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 16:29:09 user nova-compute[74048]:     </controller>
Oct 25 16:29:09 user nova-compute[74048]:     <interface type='ethernet'>
Oct 25 16:29:09 user nova-compute[74048]:       <mac address='fa:16:3e:96:f9:76'/>
Oct 25 16:29:09 user nova-compute[74048]:       <target dev='tap0334d634-48'/>
Oct 25 16:29:09 user nova-compute[74048]:       <model type='virtio'/>
Oct 25 16:29:09 user nova-compute[74048]:       <mtu size='1442'/>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='net0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </interface>
Oct 25 16:29:09 user nova-compute[74048]:     <serial type='pty'>
Oct 25 16:29:09 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:29:09 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:29:09 user nova-compute[74048]:       <target type='isa-serial' port='0'>
Oct 25 16:29:09 user nova-compute[74048]:         <model name='isa-serial'/>
Oct 25 16:29:09 user nova-compute[74048]:       </target>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </serial>
Oct 25 16:29:09 user nova-compute[74048]:     <console type='pty' tty='/dev/pts/4'>
Oct 25 16:29:09 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:29:09 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:29:09 user nova-compute[74048]:       <target type='serial' port='0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </console>
Oct 25 16:29:09 user nova-compute[74048]:     <input type='mouse' bus='ps2'>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='input0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </input>
Oct 25 16:29:09 user nova-compute[74048]:     <input type='keyboard' bus='ps2'>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='input1'/>
Oct 25 16:29:09 user nova-compute[74048]:     </input>
Oct 25 16:29:09 user nova-compute[74048]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 25 16:29:09 user nova-compute[74048]:       <listen type='address' address='0.0.0.0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </graphics>
Oct 25 16:29:09 user nova-compute[74048]:     <audio id='1' type='none'/>
Oct 25 16:29:09 user nova-compute[74048]:     <video>
Oct 25 16:29:09 user nova-compute[74048]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='video0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </video>
Oct 25 16:29:09 user nova-compute[74048]:     <memballoon model='virtio'>
Oct 25 16:29:09 user nova-compute[74048]:       <stats period='10'/>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='balloon0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </memballoon>
Oct 25 16:29:09 user nova-compute[74048]:     <rng model='virtio'>
Oct 25 16:29:09 user nova-compute[74048]:       <backend model='random'>/dev/urandom</backend>
Oct 25 16:29:09 user nova-compute[74048]:       <alias name='rng0'/>
Oct 25 16:29:09 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 16:29:09 user nova-compute[74048]:     </rng>
Oct 25 16:29:09 user nova-compute[74048]:   </devices>
Oct 25 16:29:09 user nova-compute[74048]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 16:29:09 user nova-compute[74048]:     <label>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</label>
Oct 25 16:29:09 user nova-compute[74048]:     <imagelabel>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</imagelabel>
Oct 25 16:29:09 user nova-compute[74048]:   </seclabel>
Oct 25 16:29:09 user nova-compute[74048]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 16:29:09 user nova-compute[74048]:     <label>+64055:+108</label>
Oct 25 16:29:09 user nova-compute[74048]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 16:29:09 user nova-compute[74048]:   </seclabel>
Oct 25 16:29:09 user nova-compute[74048]: </domain>
Oct 25 16:29:09 user nova-compute[74048]:  {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 16:29:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully detached device tapa03d1557-3c from instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1 from the live domain config.
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG os_vif [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa03d1557-3c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63a540b7-cf2a-4447-93b7-6664c6ef33a7) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: INFO os_vif [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c')
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:09 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:29:09</nova:creationTime>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:29:09 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:09 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:owner>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:29:09 user nova-compute[74048]:   </nova:owner>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:09 user nova-compute[74048]:   <nova:ports>
Oct 25 16:29:09 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:29:09 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:29:09 user nova-compute[74048]:     </nova:port>
Oct 25 16:29:09 user nova-compute[74048]:   </nova:ports>
Oct 25 16:29:09 user nova-compute[74048]: </nova:instance>
Oct 25 16:29:09 user nova-compute[74048]:  {{(pid=74048) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:29:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.policy [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e764a620762b42b5a094def003269c4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4357e3da93604fd0a784aa60197f688a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:29:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Creating image(s)
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "/opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "/opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "/opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-deleted-a03d1557-3c0c-4b3d-922e-e62c83fadcd3 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:09 user nova-compute[74048]: INFO nova.compute.manager [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Neutron deleted interface a03d1557-3c0c-4b3d-922e-e62c83fadcd3; detaching it from the instance and deleting it from the info cache
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.network.neutron [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.objects.instance [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Lazy-loading 'system_metadata' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquired lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.objects.instance [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Lazy-loading 'flavor' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk 1073741824" returned: 0 in 0.079s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.objects.base [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Object Instance<25e59513-b3bb-44c2-ac27-f9dcdacffed1> lazy-loaded attributes: system_metadata,flavor {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Converting VIF {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface> {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 25 16:29:10 user nova-compute[74048]:   <name>instance-00000005</name>
Oct 25 16:29:10 user nova-compute[74048]:   <uuid>25e59513-b3bb-44c2-ac27-f9dcdacffed1</uuid>
Oct 25 16:29:10 user nova-compute[74048]:   <metadata>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:10 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:29:09</nova:creationTime>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:29:10 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:owner>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:owner>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:ports>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:29:10 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:29:10 user nova-compute[74048]:     </nova:port>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:ports>
Oct 25 16:29:10 user nova-compute[74048]: </nova:instance>
Oct 25 16:29:10 user nova-compute[74048]:   </metadata>
Oct 25 16:29:10 user nova-compute[74048]:   <memory unit='KiB'>524288</memory>
Oct 25 16:29:10 user nova-compute[74048]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 16:29:10 user nova-compute[74048]:   <vcpu placement='static'>1</vcpu>
Oct 25 16:29:10 user nova-compute[74048]:   <resource>
Oct 25 16:29:10 user nova-compute[74048]:     <partition>/machine</partition>
Oct 25 16:29:10 user nova-compute[74048]:   </resource>
Oct 25 16:29:10 user nova-compute[74048]:   <sysinfo type='smbios'>
Oct 25 16:29:10 user nova-compute[74048]:     <system>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='version'>0.0.0</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='serial'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='uuid'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='family'>Virtual Machine</entry>
Oct 25 16:29:10 user nova-compute[74048]:     </system>
Oct 25 16:29:10 user nova-compute[74048]:   </sysinfo>
Oct 25 16:29:10 user nova-compute[74048]:   <os>
Oct 25 16:29:10 user nova-compute[74048]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 16:29:10 user nova-compute[74048]:     <boot dev='hd'/>
Oct 25 16:29:10 user nova-compute[74048]:     <smbios mode='sysinfo'/>
Oct 25 16:29:10 user nova-compute[74048]:   </os>
Oct 25 16:29:10 user nova-compute[74048]:   <features>
Oct 25 16:29:10 user nova-compute[74048]:     <acpi/>
Oct 25 16:29:10 user nova-compute[74048]:     <apic/>
Oct 25 16:29:10 user nova-compute[74048]:     <vmcoreinfo state='on'/>
Oct 25 16:29:10 user nova-compute[74048]:   </features>
Oct 25 16:29:10 user nova-compute[74048]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 16:29:10 user nova-compute[74048]:     <model fallback='forbid'>Nehalem</model>
Oct 25 16:29:10 user nova-compute[74048]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 16:29:10 user nova-compute[74048]:     <feature policy='require' name='vme'/>
Oct 25 16:29:10 user nova-compute[74048]:     <feature policy='require' name='x2apic'/>
Oct 25 16:29:10 user nova-compute[74048]:     <feature policy='require' name='hypervisor'/>
Oct 25 16:29:10 user nova-compute[74048]:   </cpu>
Oct 25 16:29:10 user nova-compute[74048]:   <clock offset='utc'>
Oct 25 16:29:10 user nova-compute[74048]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 16:29:10 user nova-compute[74048]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 16:29:10 user nova-compute[74048]:     <timer name='hpet' present='no'/>
Oct 25 16:29:10 user nova-compute[74048]:   </clock>
Oct 25 16:29:10 user nova-compute[74048]:   <on_poweroff>destroy</on_poweroff>
Oct 25 16:29:10 user nova-compute[74048]:   <on_reboot>restart</on_reboot>
Oct 25 16:29:10 user nova-compute[74048]:   <on_crash>destroy</on_crash>
Oct 25 16:29:10 user nova-compute[74048]:   <devices>
Oct 25 16:29:10 user nova-compute[74048]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 16:29:10 user nova-compute[74048]:     <disk type='file' device='disk'>
Oct 25 16:29:10 user nova-compute[74048]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 16:29:10 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk' index='2'/>
Oct 25 16:29:10 user nova-compute[74048]:       <backingStore type='file' index='3'>
Oct 25 16:29:10 user nova-compute[74048]:         <format type='raw'/>
Oct 25 16:29:10 user nova-compute[74048]:         <source file='/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7'/>
Oct 25 16:29:10 user nova-compute[74048]:         <backingStore/>
Oct 25 16:29:10 user nova-compute[74048]:       </backingStore>
Oct 25 16:29:10 user nova-compute[74048]:       <target dev='vda' bus='virtio'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='virtio-disk0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </disk>
Oct 25 16:29:10 user nova-compute[74048]:     <disk type='file' device='cdrom'>
Oct 25 16:29:10 user nova-compute[74048]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 16:29:10 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config' index='1'/>
Oct 25 16:29:10 user nova-compute[74048]:       <backingStore/>
Oct 25 16:29:10 user nova-compute[74048]:       <target dev='hda' bus='ide'/>
Oct 25 16:29:10 user nova-compute[74048]:       <readonly/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='ide0-0-0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </disk>
Oct 25 16:29:10 user nova-compute[74048]:     <controller type='usb' index='0' model='none'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='usb'/>
Oct 25 16:29:10 user nova-compute[74048]:     </controller>
Oct 25 16:29:10 user nova-compute[74048]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='pci.0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </controller>
Oct 25 16:29:10 user nova-compute[74048]:     <controller type='ide' index='0'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='ide'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 16:29:10 user nova-compute[74048]:     </controller>
Oct 25 16:29:10 user nova-compute[74048]:     <interface type='ethernet'>
Oct 25 16:29:10 user nova-compute[74048]:       <mac address='fa:16:3e:96:f9:76'/>
Oct 25 16:29:10 user nova-compute[74048]:       <target dev='tap0334d634-48'/>
Oct 25 16:29:10 user nova-compute[74048]:       <model type='virtio'/>
Oct 25 16:29:10 user nova-compute[74048]:       <mtu size='1442'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='net0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </interface>
Oct 25 16:29:10 user nova-compute[74048]:     <serial type='pty'>
Oct 25 16:29:10 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:29:10 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:29:10 user nova-compute[74048]:       <target type='isa-serial' port='0'>
Oct 25 16:29:10 user nova-compute[74048]:         <model name='isa-serial'/>
Oct 25 16:29:10 user nova-compute[74048]:       </target>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </serial>
Oct 25 16:29:10 user nova-compute[74048]:     <console type='pty' tty='/dev/pts/4'>
Oct 25 16:29:10 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:29:10 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:29:10 user nova-compute[74048]:       <target type='serial' port='0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </console>
Oct 25 16:29:10 user nova-compute[74048]:     <input type='mouse' bus='ps2'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='input0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </input>
Oct 25 16:29:10 user nova-compute[74048]:     <input type='keyboard' bus='ps2'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='input1'/>
Oct 25 16:29:10 user nova-compute[74048]:     </input>
Oct 25 16:29:10 user nova-compute[74048]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 25 16:29:10 user nova-compute[74048]:       <listen type='address' address='0.0.0.0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </graphics>
Oct 25 16:29:10 user nova-compute[74048]:     <audio id='1' type='none'/>
Oct 25 16:29:10 user nova-compute[74048]:     <video>
Oct 25 16:29:10 user nova-compute[74048]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='video0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </video>
Oct 25 16:29:10 user nova-compute[74048]:     <memballoon model='virtio'>
Oct 25 16:29:10 user nova-compute[74048]:       <stats period='10'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='balloon0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </memballoon>
Oct 25 16:29:10 user nova-compute[74048]:     <rng model='virtio'>
Oct 25 16:29:10 user nova-compute[74048]:       <backend model='random'>/dev/urandom</backend>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='rng0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </rng>
Oct 25 16:29:10 user nova-compute[74048]:   </devices>
Oct 25 16:29:10 user nova-compute[74048]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 16:29:10 user nova-compute[74048]:     <label>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</label>
Oct 25 16:29:10 user nova-compute[74048]:     <imagelabel>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</imagelabel>
Oct 25 16:29:10 user nova-compute[74048]:   </seclabel>
Oct 25 16:29:10 user nova-compute[74048]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 16:29:10 user nova-compute[74048]:     <label>+64055:+108</label>
Oct 25 16:29:10 user nova-compute[74048]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 16:29:10 user nova-compute[74048]:   </seclabel>
Oct 25 16:29:10 user nova-compute[74048]: </domain>
Oct 25 16:29:10 user nova-compute[74048]:  {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface> {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9d:a0:88"/><model type="virtio"/><mtu size="1442"/><target dev="tapa03d1557-3c"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 25 16:29:10 user nova-compute[74048]:   <name>instance-00000005</name>
Oct 25 16:29:10 user nova-compute[74048]:   <uuid>25e59513-b3bb-44c2-ac27-f9dcdacffed1</uuid>
Oct 25 16:29:10 user nova-compute[74048]:   <metadata>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:10 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:29:09</nova:creationTime>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:29:10 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:owner>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:owner>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:ports>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:29:10 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:29:10 user nova-compute[74048]:     </nova:port>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:ports>
Oct 25 16:29:10 user nova-compute[74048]: </nova:instance>
Oct 25 16:29:10 user nova-compute[74048]:   </metadata>
Oct 25 16:29:10 user nova-compute[74048]:   <memory unit='KiB'>524288</memory>
Oct 25 16:29:10 user nova-compute[74048]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 16:29:10 user nova-compute[74048]:   <vcpu placement='static'>1</vcpu>
Oct 25 16:29:10 user nova-compute[74048]:   <resource>
Oct 25 16:29:10 user nova-compute[74048]:     <partition>/machine</partition>
Oct 25 16:29:10 user nova-compute[74048]:   </resource>
Oct 25 16:29:10 user nova-compute[74048]:   <sysinfo type='smbios'>
Oct 25 16:29:10 user nova-compute[74048]:     <system>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='version'>0.0.0</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='serial'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='uuid'>25e59513-b3bb-44c2-ac27-f9dcdacffed1</entry>
Oct 25 16:29:10 user nova-compute[74048]:       <entry name='family'>Virtual Machine</entry>
Oct 25 16:29:10 user nova-compute[74048]:     </system>
Oct 25 16:29:10 user nova-compute[74048]:   </sysinfo>
Oct 25 16:29:10 user nova-compute[74048]:   <os>
Oct 25 16:29:10 user nova-compute[74048]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 16:29:10 user nova-compute[74048]:     <boot dev='hd'/>
Oct 25 16:29:10 user nova-compute[74048]:     <smbios mode='sysinfo'/>
Oct 25 16:29:10 user nova-compute[74048]:   </os>
Oct 25 16:29:10 user nova-compute[74048]:   <features>
Oct 25 16:29:10 user nova-compute[74048]:     <acpi/>
Oct 25 16:29:10 user nova-compute[74048]:     <apic/>
Oct 25 16:29:10 user nova-compute[74048]:     <vmcoreinfo state='on'/>
Oct 25 16:29:10 user nova-compute[74048]:   </features>
Oct 25 16:29:10 user nova-compute[74048]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 16:29:10 user nova-compute[74048]:     <model fallback='forbid'>Nehalem</model>
Oct 25 16:29:10 user nova-compute[74048]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 16:29:10 user nova-compute[74048]:     <feature policy='require' name='vme'/>
Oct 25 16:29:10 user nova-compute[74048]:     <feature policy='require' name='x2apic'/>
Oct 25 16:29:10 user nova-compute[74048]:     <feature policy='require' name='hypervisor'/>
Oct 25 16:29:10 user nova-compute[74048]:   </cpu>
Oct 25 16:29:10 user nova-compute[74048]:   <clock offset='utc'>
Oct 25 16:29:10 user nova-compute[74048]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 16:29:10 user nova-compute[74048]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 16:29:10 user nova-compute[74048]:     <timer name='hpet' present='no'/>
Oct 25 16:29:10 user nova-compute[74048]:   </clock>
Oct 25 16:29:10 user nova-compute[74048]:   <on_poweroff>destroy</on_poweroff>
Oct 25 16:29:10 user nova-compute[74048]:   <on_reboot>restart</on_reboot>
Oct 25 16:29:10 user nova-compute[74048]:   <on_crash>destroy</on_crash>
Oct 25 16:29:10 user nova-compute[74048]:   <devices>
Oct 25 16:29:10 user nova-compute[74048]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 16:29:10 user nova-compute[74048]:     <disk type='file' device='disk'>
Oct 25 16:29:10 user nova-compute[74048]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 16:29:10 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk' index='2'/>
Oct 25 16:29:10 user nova-compute[74048]:       <backingStore type='file' index='3'>
Oct 25 16:29:10 user nova-compute[74048]:         <format type='raw'/>
Oct 25 16:29:10 user nova-compute[74048]:         <source file='/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7'/>
Oct 25 16:29:10 user nova-compute[74048]:         <backingStore/>
Oct 25 16:29:10 user nova-compute[74048]:       </backingStore>
Oct 25 16:29:10 user nova-compute[74048]:       <target dev='vda' bus='virtio'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='virtio-disk0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </disk>
Oct 25 16:29:10 user nova-compute[74048]:     <disk type='file' device='cdrom'>
Oct 25 16:29:10 user nova-compute[74048]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 16:29:10 user nova-compute[74048]:       <source file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/disk.config' index='1'/>
Oct 25 16:29:10 user nova-compute[74048]:       <backingStore/>
Oct 25 16:29:10 user nova-compute[74048]:       <target dev='hda' bus='ide'/>
Oct 25 16:29:10 user nova-compute[74048]:       <readonly/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='ide0-0-0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </disk>
Oct 25 16:29:10 user nova-compute[74048]:     <controller type='usb' index='0' model='none'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='usb'/>
Oct 25 16:29:10 user nova-compute[74048]:     </controller>
Oct 25 16:29:10 user nova-compute[74048]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='pci.0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </controller>
Oct 25 16:29:10 user nova-compute[74048]:     <controller type='ide' index='0'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='ide'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 16:29:10 user nova-compute[74048]:     </controller>
Oct 25 16:29:10 user nova-compute[74048]:     <interface type='ethernet'>
Oct 25 16:29:10 user nova-compute[74048]:       <mac address='fa:16:3e:96:f9:76'/>
Oct 25 16:29:10 user nova-compute[74048]:       <target dev='tap0334d634-48'/>
Oct 25 16:29:10 user nova-compute[74048]:       <model type='virtio'/>
Oct 25 16:29:10 user nova-compute[74048]:       <mtu size='1442'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='net0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </interface>
Oct 25 16:29:10 user nova-compute[74048]:     <serial type='pty'>
Oct 25 16:29:10 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:29:10 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:29:10 user nova-compute[74048]:       <target type='isa-serial' port='0'>
Oct 25 16:29:10 user nova-compute[74048]:         <model name='isa-serial'/>
Oct 25 16:29:10 user nova-compute[74048]:       </target>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </serial>
Oct 25 16:29:10 user nova-compute[74048]:     <console type='pty' tty='/dev/pts/4'>
Oct 25 16:29:10 user nova-compute[74048]:       <source path='/dev/pts/4'/>
Oct 25 16:29:10 user nova-compute[74048]:       <log file='/opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1/console.log' append='off'/>
Oct 25 16:29:10 user nova-compute[74048]:       <target type='serial' port='0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='serial0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </console>
Oct 25 16:29:10 user nova-compute[74048]:     <input type='mouse' bus='ps2'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='input0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </input>
Oct 25 16:29:10 user nova-compute[74048]:     <input type='keyboard' bus='ps2'>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='input1'/>
Oct 25 16:29:10 user nova-compute[74048]:     </input>
Oct 25 16:29:10 user nova-compute[74048]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 25 16:29:10 user nova-compute[74048]:       <listen type='address' address='0.0.0.0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </graphics>
Oct 25 16:29:10 user nova-compute[74048]:     <audio id='1' type='none'/>
Oct 25 16:29:10 user nova-compute[74048]:     <video>
Oct 25 16:29:10 user nova-compute[74048]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='video0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </video>
Oct 25 16:29:10 user nova-compute[74048]:     <memballoon model='virtio'>
Oct 25 16:29:10 user nova-compute[74048]:       <stats period='10'/>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='balloon0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </memballoon>
Oct 25 16:29:10 user nova-compute[74048]:     <rng model='virtio'>
Oct 25 16:29:10 user nova-compute[74048]:       <backend model='random'>/dev/urandom</backend>
Oct 25 16:29:10 user nova-compute[74048]:       <alias name='rng0'/>
Oct 25 16:29:10 user nova-compute[74048]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 16:29:10 user nova-compute[74048]:     </rng>
Oct 25 16:29:10 user nova-compute[74048]:   </devices>
Oct 25 16:29:10 user nova-compute[74048]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 16:29:10 user nova-compute[74048]:     <label>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</label>
Oct 25 16:29:10 user nova-compute[74048]:     <imagelabel>libvirt-25e59513-b3bb-44c2-ac27-f9dcdacffed1</imagelabel>
Oct 25 16:29:10 user nova-compute[74048]:   </seclabel>
Oct 25 16:29:10 user nova-compute[74048]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 16:29:10 user nova-compute[74048]:     <label>+64055:+108</label>
Oct 25 16:29:10 user nova-compute[74048]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 16:29:10 user nova-compute[74048]:   </seclabel>
Oct 25 16:29:10 user nova-compute[74048]: </domain>
Oct 25 16:29:10 user nova-compute[74048]:  {{(pid=74048) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 16:29:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Detaching interface fa:16:3e:9d:a0:88 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa03d1557-3c' not found.
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Converting VIF {"id": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "address": "fa:16:3e:9d:a0:88", "network": {"id": "5934e6e2-5c31-413d-ba46-906dda684aab", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1652429865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa03d1557-3c", "ovs_interfaceid": "a03d1557-3c0c-4b3d-922e-e62c83fadcd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG os_vif [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa03d1557-3c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:29:10 user nova-compute[74048]: INFO os_vif [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a0:88,bridge_name='br-int',has_traffic_filtering=True,id=a03d1557-3c0c-4b3d-922e-e62c83fadcd3,network=Network(5934e6e2-5c31-413d-ba46-906dda684aab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa03d1557-3c')
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [req-d2714292-425b-43e2-b074-2b8ff24eebf8 req-f06fe2d1-68cf-4c63-b94c-d8030fd76639 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:10 user nova-compute[74048]:   <nova:package version="0.0.0"/>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:name>tempest-device-tagging-server-1725990459</nova:name>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:creationTime>2023-10-25 16:29:10</nova:creationTime>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:flavor name="m1.tiny">
Oct 25 16:29:10 user nova-compute[74048]:     <nova:memory>512</nova:memory>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:disk>1</nova:disk>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:swap>0</nova:swap>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:flavor>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:owner>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:user uuid="9d9a5ea3d09a4616b439473e03ec3bab">tempest-TaggedAttachmentsTest-1680538480-project-member</nova:user>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:project uuid="7da4a9d7ce314c309771155151f1841d">tempest-TaggedAttachmentsTest-1680538480</nova:project>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:owner>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:10 user nova-compute[74048]:   <nova:ports>
Oct 25 16:29:10 user nova-compute[74048]:     <nova:port uuid="0334d634-48ac-4890-a7cc-a85599ae2cef">
Oct 25 16:29:10 user nova-compute[74048]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:29:10 user nova-compute[74048]:     </nova:port>
Oct 25 16:29:10 user nova-compute[74048]:   </nova:ports>
Oct 25 16:29:10 user nova-compute[74048]: </nova:instance>
Oct 25 16:29:10 user nova-compute[74048]:  {{(pid=74048) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Cannot resize image /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Ensure instance console log exists: /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.network.neutron [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Successfully created port: b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [{"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Releasing lock "refresh_cache-25e59513-b3bb-44c2-ac27-f9dcdacffed1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:29:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e98e4981-1298-428d-be88-91bff6e24878 tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "interface-25e59513-b3bb-44c2-ac27-f9dcdacffed1-a03d1557-3c0c-4b3d-922e-e62c83fadcd3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.308s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Successfully updated port: b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:29:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "refresh_cache-405bc4c3-4446-45f1-aa47-439e298cdddd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:29:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquired lock "refresh_cache-405bc4c3-4446-45f1-aa47-439e298cdddd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:29:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:29:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-changed-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Refreshing instance network info cache due to event network-changed-b7bee044-63d3-4bc2-b790-fd3ad318caec. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] Acquiring lock "refresh_cache-405bc4c3-4446-45f1-aa47-439e298cdddd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Updating instance_info_cache with network_info: [{"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Releasing lock "refresh_cache-405bc4c3-4446-45f1-aa47-439e298cdddd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Instance network_info: |[{"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] Acquired lock "refresh_cache-405bc4c3-4446-45f1-aa47-439e298cdddd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Refreshing network info cache for port b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Start _get_guest_xml network_info=[{"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:29:12 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:29:12 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1253644515',display_name='tempest-VolumesAdminNegativeTest-server-1253644515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1253644515',id=14,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4357e3da93604fd0a784aa60197f688a',ramdisk_id='',reservation_id='r-pqtg0qke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1275180142',owner_user_name='tempest-VolumesAdminNegativeTest-1275180142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:29:09Z,user_data=None,user_id='e764a620762b42b5a094def003269c4f',uuid=405bc4c3-4446-45f1-aa47-439e298cdddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converting VIF {"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.objects.instance [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'pci_devices' on Instance uuid 405bc4c3-4446-45f1-aa47-439e298cdddd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:29:12 user nova-compute[74048]:   <uuid>405bc4c3-4446-45f1-aa47-439e298cdddd</uuid>
Oct 25 16:29:12 user nova-compute[74048]:   <name>instance-0000000e</name>
Oct 25 16:29:12 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:29:12 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:29:12 user nova-compute[74048]:   <metadata>
Oct 25 16:29:12 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:12 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:29:12 user nova-compute[74048]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1253644515</nova:name>
Oct 25 16:29:12 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:29:12</nova:creationTime>
Oct 25 16:29:12 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:29:12 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:12 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:29:12 user nova-compute[74048]:       <nova:owner>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:user uuid="e764a620762b42b5a094def003269c4f">tempest-VolumesAdminNegativeTest-1275180142-project-member</nova:user>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:project uuid="4357e3da93604fd0a784aa60197f688a">tempest-VolumesAdminNegativeTest-1275180142</nova:project>
Oct 25 16:29:12 user nova-compute[74048]:       </nova:owner>
Oct 25 16:29:12 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:12 user nova-compute[74048]:       <nova:ports>
Oct 25 16:29:12 user nova-compute[74048]:         <nova:port uuid="b7bee044-63d3-4bc2-b790-fd3ad318caec">
Oct 25 16:29:12 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 16:29:12 user nova-compute[74048]:         </nova:port>
Oct 25 16:29:12 user nova-compute[74048]:       </nova:ports>
Oct 25 16:29:12 user nova-compute[74048]:     </nova:instance>
Oct 25 16:29:12 user nova-compute[74048]:   </metadata>
Oct 25 16:29:12 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:29:12 user nova-compute[74048]:     <system>
Oct 25 16:29:12 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:29:12 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:29:12 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:29:12 user nova-compute[74048]:       <entry name="serial">405bc4c3-4446-45f1-aa47-439e298cdddd</entry>
Oct 25 16:29:12 user nova-compute[74048]:       <entry name="uuid">405bc4c3-4446-45f1-aa47-439e298cdddd</entry>
Oct 25 16:29:12 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:29:12 user nova-compute[74048]:     </system>
Oct 25 16:29:12 user nova-compute[74048]:   </sysinfo>
Oct 25 16:29:12 user nova-compute[74048]:   <os>
Oct 25 16:29:12 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:29:12 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:29:12 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:29:12 user nova-compute[74048]:   </os>
Oct 25 16:29:12 user nova-compute[74048]:   <features>
Oct 25 16:29:12 user nova-compute[74048]:     <acpi/>
Oct 25 16:29:12 user nova-compute[74048]:     <apic/>
Oct 25 16:29:12 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:29:12 user nova-compute[74048]:   </features>
Oct 25 16:29:12 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:29:12 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:29:12 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:29:12 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:29:12 user nova-compute[74048]:   </clock>
Oct 25 16:29:12 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:29:12 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:29:12 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:29:12 user nova-compute[74048]:   </cpu>
Oct 25 16:29:12 user nova-compute[74048]:   <devices>
Oct 25 16:29:12 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:29:12 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:29:12 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk"/>
Oct 25 16:29:12 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:29:12 user nova-compute[74048]:     </disk>
Oct 25 16:29:12 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:29:12 user nova-compute[74048]:       <mac address="fa:16:3e:5d:71:09"/>
Oct 25 16:29:12 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:29:12 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:29:12 user nova-compute[74048]:       <target dev="tapb7bee044-63"/>
Oct 25 16:29:12 user nova-compute[74048]:     </interface>
Oct 25 16:29:12 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:29:12 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/console.log" append="off"/>
Oct 25 16:29:12 user nova-compute[74048]:     </serial>
Oct 25 16:29:12 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:29:12 user nova-compute[74048]:     <video>
Oct 25 16:29:12 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:29:12 user nova-compute[74048]:     </video>
Oct 25 16:29:12 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:29:12 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:29:12 user nova-compute[74048]:     </rng>
Oct 25 16:29:12 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:29:12 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:29:12 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:29:12 user nova-compute[74048]:     </memballoon>
Oct 25 16:29:12 user nova-compute[74048]:   </devices>
Oct 25 16:29:12 user nova-compute[74048]: </domain>
Oct 25 16:29:12 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1253644515',display_name='tempest-VolumesAdminNegativeTest-server-1253644515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1253644515',id=14,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4357e3da93604fd0a784aa60197f688a',ramdisk_id='',reservation_id='r-pqtg0qke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1275180142',owner_user_name='tempest-VolumesAdminNegativeTest-1275180142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:29:09Z,user_data=None,user_id='e764a620762b42b5a094def003269c4f',uuid=405bc4c3-4446-45f1-aa47-439e298cdddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converting VIF {"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG os_vif [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7be9d6e0-30dd-5c1a-823e-b7e2d1fe4532', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7bee044-63, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7bee044-63, col_values=(('qos', UUID('04ddf19c-bc03-451e-b354-4948828d19bb')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7bee044-63, col_values=(('external_ids', {'iface-id': 'b7bee044-63d3-4bc2-b790-fd3ad318caec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:71:09', 'vm-uuid': '405bc4c3-4446-45f1-aa47-439e298cdddd'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:12 user nova-compute[74048]: INFO os_vif [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63')
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] No VIF found with MAC fa:16:3e:5d:71:09, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Updated VIF entry in instance network info cache for port b7bee044-63d3-4bc2-b790-fd3ad318caec. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Updating instance_info_cache with network_info: [{"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4c6e072e-501e-466e-9c62-d40d9a69f952 req-b8a8744d-8f23-4cca-882a-b9ef0f229154 service nova] Releasing lock "refresh_cache-405bc4c3-4446-45f1-aa47-439e298cdddd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-9d2eab0d-171b-4670-903f-7016ac5f2653 req-81ce0444-4cc1-4d6d-933d-47fe2e0bb7f3 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d2eab0d-171b-4670-903f-7016ac5f2653 req-81ce0444-4cc1-4d6d-933d-47fe2e0bb7f3 service nova] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d2eab0d-171b-4670-903f-7016ac5f2653 req-81ce0444-4cc1-4d6d-933d-47fe2e0bb7f3 service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d2eab0d-171b-4670-903f-7016ac5f2653 req-81ce0444-4cc1-4d6d-933d-47fe2e0bb7f3 service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-9d2eab0d-171b-4670-903f-7016ac5f2653 req-81ce0444-4cc1-4d6d-933d-47fe2e0bb7f3 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] No waiting events found dispatching network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:13 user nova-compute[74048]: WARNING nova.compute.manager [req-9d2eab0d-171b-4670-903f-7016ac5f2653 req-81ce0444-4cc1-4d6d-933d-47fe2e0bb7f3 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received unexpected event network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec for instance with vm_state building and task_state spawning.
Oct 25 16:29:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ae1fcb2-fa7f-44f5-8661-1271668567bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82864e7-21ff-4621-b808-205be1faa6e3', 'serial': 'd82864e7-21ff-4621-b808-205be1faa6e3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFYtwhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'a90a40ec-02fa-434a-8905-17eb88a981a4'}, 'status': 'reserved', 'instance': '4ae1fcb2-fa7f-44f5-8661-1271668567bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'a90a40ec-02fa-434a-8905-17eb88a981a4', 'serial'} {{(pid=74048) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:29:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:29:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:29:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:29:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:29:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:29:14 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:29:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5867f3-8a16-4c9c-8850-337f7ecbbc89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:29:15 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ec43e-91ee-4028-bb58-650f797c097e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3] added
Oct 25 16:29:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c1654-986d-47c5-9e75-aa040bc70847]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8384c7-de68-4cc5-9efe-65be7c997e32]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlTcZxvB {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlTcZxvB" returned: 0 in 0.044s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[68973891-6589-45b8-91ea-342b8d4a4dce]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qlTcZxvB'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb8244-91b1-48df-a28f-d8efe6d2f5c5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8137359b-3013-4438-9a22-75d0a2891483]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a9011e-ee2c-4f7c-82fd-6a46b73e60f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]
Oct 25 16:29:15 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.
Oct 25 16:29:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f30383-2e4c-42e5-8a64-e46ca2ab3950]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f6456e-5603-4126-8717-868c830d046f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:15 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da615b-7c0f-475b-8ba7-7cc71268a2b6]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc req-00251557-c70b-4e1b-9f6a-4b36f3e96052 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event volume-reimaged-0f82c659-17b7-4d55-a2a5-ddc7172ba044 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc req-00251557-c70b-4e1b-9f6a-4b36f3e96052 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc req-00251557-c70b-4e1b-9f6a-4b36f3e96052 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc req-00251557-c70b-4e1b-9f6a-4b36f3e96052 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc req-00251557-c70b-4e1b-9f6a-4b36f3e96052 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Processing event volume-reimaged-0f82c659-17b7-4d55-a2a5-ddc7172ba044 {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance event wait completed in 53 seconds for volume-reimaged {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:29:15 user nova-compute[74048]: INFO nova.virt.block_device [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Booting with volume 0f82c659-17b7-4d55-a2a5-ddc7172ba044 at /dev/vda
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.utils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a68813-d6d6-422c-9b84-01b90b92f534]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f69bfba-0545-4c59-839d-0d1fe748fe37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3b5be-b20c-4591-a4d4-f62b45a04e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ea5c0-2687-49c5-917f-6bd0224163cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:29:15 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:29:15 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[91986ec4-e33c-492b-a9d5-8c32b0bf93ae]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG os_brick.utils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:29:15 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updating existing volume attachment record: 75d06501-abd5-43de-bf3e-837c83a0d691 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-3c64bdb6-ecd3-4edb-a546-7393b3c246de req-b8742e85-c0f8-472a-99a8-8acc7bbe5a0f service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3c64bdb6-ecd3-4edb-a546-7393b3c246de req-b8742e85-c0f8-472a-99a8-8acc7bbe5a0f service nova] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3c64bdb6-ecd3-4edb-a546-7393b3c246de req-b8742e85-c0f8-472a-99a8-8acc7bbe5a0f service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3c64bdb6-ecd3-4edb-a546-7393b3c246de req-b8742e85-c0f8-472a-99a8-8acc7bbe5a0f service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-3c64bdb6-ecd3-4edb-a546-7393b3c246de req-b8742e85-c0f8-472a-99a8-8acc7bbe5a0f service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] No waiting events found dispatching network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:16 user nova-compute[74048]: WARNING nova.compute.manager [req-3c64bdb6-ecd3-4edb-a546-7393b3c246de req-b8742e85-c0f8-472a-99a8-8acc7bbe5a0f service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received unexpected event network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec for instance with vm_state building and task_state spawning.
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:29:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Instance spawned successfully.
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:16 user nova-compute[74048]: INFO nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Took 6.63 seconds to spawn the instance on the hypervisor.
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:29:16 user nova-compute[74048]: INFO nova.compute.manager [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Took 7.63 seconds to build instance.
Oct 25 16:29:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-29cb7d5c-0072-48a8-b402-5c57f7bfa0a4 tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.746s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23531643466653431', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643466653431', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lazy-loading 'flavor' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 104857600 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 214958080 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 330301440 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 481296384 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 656408576 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "15012856-adde-4587-b34e-979a0441bbaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:19 user nova-compute[74048]: INFO nova.compute.manager [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Terminating instance
Oct 25 16:29:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-da8cfbc3-640c-41bf-b9de-d53ae6d9a16f req-516bcd25-21f5-4086-b023-526d80c766ac service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-unplugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da8cfbc3-640c-41bf-b9de-d53ae6d9a16f req-516bcd25-21f5-4086-b023-526d80c766ac service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da8cfbc3-640c-41bf-b9de-d53ae6d9a16f req-516bcd25-21f5-4086-b023-526d80c766ac service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da8cfbc3-640c-41bf-b9de-d53ae6d9a16f req-516bcd25-21f5-4086-b023-526d80c766ac service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-da8cfbc3-640c-41bf-b9de-d53ae6d9a16f req-516bcd25-21f5-4086-b023-526d80c766ac service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-unplugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-da8cfbc3-640c-41bf-b9de-d53ae6d9a16f req-516bcd25-21f5-4086-b023-526d80c766ac service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-unplugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Instance destroyed successfully.
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.objects.instance [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lazy-loading 'resources' on Instance uuid 15012856-adde-4587-b34e-979a0441bbaf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-551467228',display_name='tempest-VolumesAssistedSnapshotsTest-server-551467228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-551467228',id=9,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIa+4X6Rj9i3w3Unln0a35dVUOp4vaUqrtzRwMy3CPqsnqoKu8HA+JzPY90uptkQkrSzEpfPX4PalTOxqlO39ENCOGN4WRKmqhu1j3ES3Oncf+jC4HcoOwJaLVcWpZN7g==',key_name='tempest-keypair-1934088057',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f5cef700c34a0db5b5877632eac00d',ramdisk_id='',reservation_id='r-hlpy1yuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1206811372',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1206811372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fffbda38c6543b19f6ccc95bbacf9b8',uuid=15012856-adde-4587-b34e-979a0441bbaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Converting VIF {"id": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "address": "fa:16:3e:ba:1b:10", "network": {"id": "785e4af9-6f32-4174-852b-8236c63e6cd9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-523327543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f5cef700c34a0db5b5877632eac00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed3a24-7d", "ovs_interfaceid": "afed3a24-7d29-47ed-91f8-58db79a2d4e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG os_vif [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafed3a24-7d, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f047ff99-2daa-446f-bdc6-671d62cf4bb5) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:29:20 user nova-compute[74048]: INFO os_vif [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:1b:10,bridge_name='br-int',has_traffic_filtering=True,id=afed3a24-7d29-47ed-91f8-58db79a2d4e9,network=Network(785e4af9-6f32-4174-852b-8236c63e6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed3a24-7d')
Oct 25 16:29:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Deleting instance files /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf_del
Oct 25 16:29:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Deletion of /opt/stack/data/nova/instances/15012856-adde-4587-b34e-979a0441bbaf_del complete
Oct 25 16:29:20 user nova-compute[74048]: INFO nova.compute.manager [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 25 16:29:20 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 15012856-adde-4587-b34e-979a0441bbaf] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:29:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 1005584384 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yWFYtwhv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'a90a40ec-02fa-434a-8905-17eb88a981a4'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:29:21 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb8a63c-e17d-4e1b-b251-2f776cac1f6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:29:21 user nova-compute[74048]: No targets found.
Oct 25 16:29:21 user nova-compute[74048]: iSNS:
Oct 25 16:29:21 user nova-compute[74048]: No targets found.
Oct 25 16:29:21 user nova-compute[74048]: STATIC:
Oct 25 16:29:21 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:29:21 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:21 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:21 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4
Oct 25 16:29:21 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:21 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:21 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:29:21 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:21 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:21 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:29:21 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:21 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:21 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:29:21 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:21 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:21 user nova-compute[74048]: FIRMWARE:
Oct 25 16:29:21 user nova-compute[74048]: No targets found.
Oct 25 16:29:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:29:21 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:29:21 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ee5ae6-ea71-455e-add0-a28c1d2fd6d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce74ed-5288-4de3-b711-13667d0d6895]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18406c3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f71429-58fa-463a-b893-eba3205bb311]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daec060-e5d6-41d6-9699-7738b7b08f60]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef8da13-32a9-4ab0-a7b3-4d3724dfd12a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:21 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Took 1.21 seconds to deallocate network for instance.
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e01b4f-4f22-48f7-95b7-673ba49d0b4a]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-f3b17b7b-c3f4-420b-b8a7-acffb0998ab7 req-8d9b44d7-0925-4e9e-a1f7-3e891026c322 service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-deleted-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce74996-4c4b-4141-9795-a3e04d09ae19]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9378a-5597-4359-9ea3-803456fe47b2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260]
Oct 25 16:29:22 user nova-compute[74048]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4, portal: 172.16.0.220,3260] successful.
Oct 25 16:29:22 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a90a40ec-02fa-434a-8905-17eb88a981a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[58626a07-d47c-42e6-9839-4433d5a27bf4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] <== disconnect_volume: return (422ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:22 user nova-compute[74048]: WARNING nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state deleted and task_state None.
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:22 user nova-compute[74048]: WARNING nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state deleted and task_state None.
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:22 user nova-compute[74048]: WARNING nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state deleted and task_state None.
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-unplugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-unplugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:22 user nova-compute[74048]: WARNING nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-unplugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state deleted and task_state None.
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Acquiring lock "15012856-adde-4587-b34e-979a0441bbaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] Lock "15012856-adde-4587-b34e-979a0441bbaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] No waiting events found dispatching network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:22 user nova-compute[74048]: WARNING nova.compute.manager [req-f4fe15f9-669e-426f-ae03-6b7517a970d6 req-50f811b1-dfda-458b-bdf8-f9c6d16e180f service nova] [instance: 15012856-adde-4587-b34e-979a0441bbaf] Received unexpected event network-vif-plugged-afed3a24-7d29-47ed-91f8-58db79a2d4e9 for instance with vm_state deleted and task_state None.
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '4ae1fcb2-fa7f-44f5-8661-1271668567bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82864e7-21ff-4621-b808-205be1faa6e3', 'serial'} {{(pid=74048) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] swap_volume: removing Cinder connection for volume a90a40ec-02fa-434a-8905-17eb88a981a4 {{(pid=74048) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:22 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Deleted allocations for instance 15012856-adde-4587-b34e-979a0441bbaf
Oct 25 16:29:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-db0c5b2d-204d-4c71-a0f2-acfddbc55b76 tempest-VolumesAssistedSnapshotsTest-1206811372 tempest-VolumesAssistedSnapshotsTest-1206811372-project-member] Lock "15012856-adde-4587-b34e-979a0441bbaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.126s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:23 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] swap_volume: Updating volume a90a40ec-02fa-434a-8905-17eb88a981a4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "qlTcZxvB", "auth_password": "Ph5DzAux2YBS4G", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "d82864e7-21ff-4621-b808-205be1faa6e3"}, "status": "reserved", "instance": "4ae1fcb2-fa7f-44f5-8661-1271668567bd", "attached_at": "", "detached_at": "", "volume_id": "d82864e7-21ff-4621-b808-205be1faa6e3", "serial": "d82864e7-21ff-4621-b808-205be1faa6e3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd82864e7-21ff-4621-b808-205be1faa6e3', 'no_device': None, 'attachment_id': '936f014a-bf19-4a12-9a28-b818db71ecab'} {{(pid=74048) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 25 16:29:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fcff391f-1bda-4509-924e-4444bcd73ad7 tempest-TestVolumeSwap-1440268272 tempest-TestVolumeSwap-1440268272-project-admin] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.958s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:24 user nova-compute[74048]: INFO nova.compute.manager [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Detaching volume d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:29:24 user nova-compute[74048]: INFO nova.virt.block_device [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Attempting to driver detach volume d82864e7-21ff-4621-b808-205be1faa6e3 from mountpoint /dev/vdb
Oct 25 16:29:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Attempting to detach device vdb from instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:29:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:29:24 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:29:24 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 16:29:24 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:29:24 user nova-compute[74048]:   <serial>d82864e7-21ff-4621-b808-205be1faa6e3</serial>
Oct 25 16:29:24 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:29:24 user nova-compute[74048]: </disk>
Oct 25 16:29:24 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:29:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Successfully detached device vdb from instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd from the persistent domain config.
Oct 25 16:29:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:29:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:29:24 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:29:24 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 16:29:24 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:29:24 user nova-compute[74048]:   <serial>d82864e7-21ff-4621-b808-205be1faa6e3</serial>
Oct 25 16:29:24 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:29:24 user nova-compute[74048]: </disk>
Oct 25 16:29:24 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:29:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:29:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:31 user nova-compute[74048]: INFO nova.compute.manager [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Rescuing
Oct 25 16:29:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:29:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:29:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-55f0ed2b-8f0d-4df8-9891-35973a56bf9b req-fc8c5e61-d454-4d51-9300-5813c9cfc3cb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55f0ed2b-8f0d-4df8-9891-35973a56bf9b req-fc8c5e61-d454-4d51-9300-5813c9cfc3cb service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55f0ed2b-8f0d-4df8-9891-35973a56bf9b req-fc8c5e61-d454-4d51-9300-5813c9cfc3cb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55f0ed2b-8f0d-4df8-9891-35973a56bf9b req-fc8c5e61-d454-4d51-9300-5813c9cfc3cb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-55f0ed2b-8f0d-4df8-9891-35973a56bf9b req-fc8c5e61-d454-4d51-9300-5813c9cfc3cb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:32 user nova-compute[74048]: WARNING nova.compute.manager [req-55f0ed2b-8f0d-4df8-9891-35973a56bf9b req-fc8c5e61-d454-4d51-9300-5813c9cfc3cb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state active and task_state rescuing.
Oct 25 16:29:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance destroyed successfully.
Oct 25 16:29:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Attempting rescue
Oct 25 16:29:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74048) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:29:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Creating image(s)
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'trusted_certs' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue" returned: 0 in 0.062s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'migration_context' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.base [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<f436dc02-f6f1-4e54-8d87-608a462a107c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Start _get_guest_xml network_info=[{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:5f:0c:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'resources' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.base [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<f436dc02-f6f1-4e54-8d87-608a462a107c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'numa_topology' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.base [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<f436dc02-f6f1-4e54-8d87-608a462a107c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:29:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:29:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'vcpu_model' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.base [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<f436dc02-f6f1-4e54-8d87-608a462a107c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-924952119',display_name='tempest-ServerRescueNegativeTestJSON-server-924952119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-924952119',id=1,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-uqtezwev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:24:52Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=f436dc02-f6f1-4e54-8d87-608a462a107c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:5f:0c:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:5f:0c:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'pci_devices' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.objects.base [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<f436dc02-f6f1-4e54-8d87-608a462a107c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:29:33 user nova-compute[74048]:   <uuid>f436dc02-f6f1-4e54-8d87-608a462a107c</uuid>
Oct 25 16:29:33 user nova-compute[74048]:   <name>instance-00000001</name>
Oct 25 16:29:33 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:29:33 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:29:33 user nova-compute[74048]:   <metadata>
Oct 25 16:29:33 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:33 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:29:33 user nova-compute[74048]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-924952119</nova:name>
Oct 25 16:29:33 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:29:33</nova:creationTime>
Oct 25 16:29:33 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:29:33 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:33 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:29:33 user nova-compute[74048]:       <nova:owner>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:user uuid="94ff1b26939b49ba88fe0105bec65fc2">tempest-ServerRescueNegativeTestJSON-1121503960-project-member</nova:user>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:project uuid="931f649d6b844bbdaec9f1b97ab1112c">tempest-ServerRescueNegativeTestJSON-1121503960</nova:project>
Oct 25 16:29:33 user nova-compute[74048]:       </nova:owner>
Oct 25 16:29:33 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:29:33 user nova-compute[74048]:       <nova:ports>
Oct 25 16:29:33 user nova-compute[74048]:         <nova:port uuid="9730b0be-a374-415e-8132-58e629dd7caf">
Oct 25 16:29:33 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 16:29:33 user nova-compute[74048]:         </nova:port>
Oct 25 16:29:33 user nova-compute[74048]:       </nova:ports>
Oct 25 16:29:33 user nova-compute[74048]:     </nova:instance>
Oct 25 16:29:33 user nova-compute[74048]:   </metadata>
Oct 25 16:29:33 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:29:33 user nova-compute[74048]:     <system>
Oct 25 16:29:33 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:29:33 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:29:33 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:29:33 user nova-compute[74048]:       <entry name="serial">f436dc02-f6f1-4e54-8d87-608a462a107c</entry>
Oct 25 16:29:33 user nova-compute[74048]:       <entry name="uuid">f436dc02-f6f1-4e54-8d87-608a462a107c</entry>
Oct 25 16:29:33 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:29:33 user nova-compute[74048]:     </system>
Oct 25 16:29:33 user nova-compute[74048]:   </sysinfo>
Oct 25 16:29:33 user nova-compute[74048]:   <os>
Oct 25 16:29:33 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:29:33 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:29:33 user nova-compute[74048]:   </os>
Oct 25 16:29:33 user nova-compute[74048]:   <features>
Oct 25 16:29:33 user nova-compute[74048]:     <acpi/>
Oct 25 16:29:33 user nova-compute[74048]:     <apic/>
Oct 25 16:29:33 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:29:33 user nova-compute[74048]:   </features>
Oct 25 16:29:33 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:29:33 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:29:33 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:29:33 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:29:33 user nova-compute[74048]:   </clock>
Oct 25 16:29:33 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:29:33 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:29:33 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:29:33 user nova-compute[74048]:   </cpu>
Oct 25 16:29:33 user nova-compute[74048]:   <devices>
Oct 25 16:29:33 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:29:33 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:29:33 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue"/>
Oct 25 16:29:33 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:29:33 user nova-compute[74048]:     </disk>
Oct 25 16:29:33 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:29:33 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:29:33 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk"/>
Oct 25 16:29:33 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:29:33 user nova-compute[74048]:     </disk>
Oct 25 16:29:33 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:29:33 user nova-compute[74048]:       <mac address="fa:16:3e:5f:0c:f4"/>
Oct 25 16:29:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:29:33 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:29:33 user nova-compute[74048]:       <target dev="tap9730b0be-a3"/>
Oct 25 16:29:33 user nova-compute[74048]:     </interface>
Oct 25 16:29:33 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:29:33 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/console.log" append="off"/>
Oct 25 16:29:33 user nova-compute[74048]:     </serial>
Oct 25 16:29:33 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:29:33 user nova-compute[74048]:     <video>
Oct 25 16:29:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:29:33 user nova-compute[74048]:     </video>
Oct 25 16:29:33 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:29:33 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:29:33 user nova-compute[74048]:     </rng>
Oct 25 16:29:33 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:29:33 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:29:33 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:29:33 user nova-compute[74048]:     </memballoon>
Oct 25 16:29:33 user nova-compute[74048]:   </devices>
Oct 25 16:29:33 user nova-compute[74048]: </domain>
Oct 25 16:29:33 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:29:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance destroyed successfully.
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:29:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:5f:0c:f4, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-083aff0b-daf3-4503-9b96-eb873182f536 req-f2744545-4eba-4889-ad38-dca7462c569a service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-083aff0b-daf3-4503-9b96-eb873182f536 req-f2744545-4eba-4889-ad38-dca7462c569a service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-083aff0b-daf3-4503-9b96-eb873182f536 req-f2744545-4eba-4889-ad38-dca7462c569a service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-083aff0b-daf3-4503-9b96-eb873182f536 req-f2744545-4eba-4889-ad38-dca7462c569a service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-083aff0b-daf3-4503-9b96-eb873182f536 req-f2744545-4eba-4889-ad38-dca7462c569a service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:34 user nova-compute[74048]: WARNING nova.compute.manager [req-083aff0b-daf3-4503-9b96-eb873182f536 req-f2744545-4eba-4889-ad38-dca7462c569a service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state active and task_state rescuing.
Oct 25 16:29:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:36 user nova-compute[74048]: WARNING nova.compute.manager [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state active and task_state rescuing.
Oct 25 16:29:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:36 user nova-compute[74048]: WARNING nova.compute.manager [req-aae3ae87-7859-4c9b-bed0-899220988446 req-f2f65636-da31-4b53-bd61-3cbe4cc5ba4d service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state active and task_state rescuing.
Oct 25 16:29:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1c5bd8ce-3f27-4e9a-9838-0a74a14a8220 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:29:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Creating image(s)
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Ensure instance console log exists: /opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Start _get_guest_xml network_info=[{"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '75d06501-abd5-43de-bf3e-837c83a0d691', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bdfc844-9046-4f08-b276-2eee1d5fc5c3', 'attached_at': '', 'detached_at': '', 'volume_id': '0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'serial': '0f82c659-17b7-4d55-a2a5-ddc7172ba044'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:29:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 16:29:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.objects.instance [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:29:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:29:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:29:37 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7779fe9-e56f-4579-859f-fdd9eacd10e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:29:37 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c059e4f-2d86-431a-8d21-9ffcfde663f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044] added
Oct 25 16:29:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e7569d-bc19-4db5-a639-ef5f4226267d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2d10f8-c3bd-41b9-aadb-3493a95a24a9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsEtyDxH {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsEtyDxH" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d7b660-c418-4d99-a58e-96cb9bbe089b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsEtyDxH'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2768a6-3019-46f4-b24e-a2049dbe8ca8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f460f-142c-47cf-bb40-4badafb166ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:37 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:37 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:37 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:37 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:37 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:37 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:29:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[36947da6-0855-44be-baf5-64a9ecf931b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]
Oct 25 16:29:38 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.
Oct 25 16:29:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7c89fe-7c75-4974-b10b-a8edcd365297]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0d2e9c-ac2d-4919-9b94-401714654e77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f2cfa5-840a-428c-a446-2539c3d28a07]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:29:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23762613363383265', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762613363383265', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-166486840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382712036',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjjojn8YvnWNnajLosTW7x1rEzFmEFfnM1fIXglgkUuo3CmTU0gSBineq0pi5f4jomsN5QQoXslmxH2A46axyunIDAhWEP2hpfFpWoacytfPoUYSAhxnWVokf1k7zVdXQ==',key_name='tempest-keypair-734782483',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1265f3be7364d58b49cca5d7b7be97a',ramdisk_id='',reservation_id='r-tw4vdi7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-599396862',owner_user_name='tempest-ServerActionsV293TestJSON-599396862-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0503e1c84bd641b48406fcf9dbdda397',uuid=1bdfc844-9046-4f08-b276-2eee1d5fc5c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converting VIF {"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:29:39 user nova-compute[74048]:   <uuid>1bdfc844-9046-4f08-b276-2eee1d5fc5c3</uuid>
Oct 25 16:29:39 user nova-compute[74048]:   <name>instance-0000000a</name>
Oct 25 16:29:39 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:29:39 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:29:39 user nova-compute[74048]:   <metadata>
Oct 25 16:29:39 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:29:39 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:29:39 user nova-compute[74048]:       <nova:name>tempest-ServerActionsV293TestJSON-server-166486840</nova:name>
Oct 25 16:29:39 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:29:37</nova:creationTime>
Oct 25 16:29:39 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:29:39 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:29:39 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:29:39 user nova-compute[74048]:       <nova:owner>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:user uuid="0503e1c84bd641b48406fcf9dbdda397">tempest-ServerActionsV293TestJSON-599396862-project-member</nova:user>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:project uuid="f1265f3be7364d58b49cca5d7b7be97a">tempest-ServerActionsV293TestJSON-599396862</nova:project>
Oct 25 16:29:39 user nova-compute[74048]:       </nova:owner>
Oct 25 16:29:39 user nova-compute[74048]:       <nova:ports>
Oct 25 16:29:39 user nova-compute[74048]:         <nova:port uuid="ebbda323-9a84-4f24-9a1c-6c3359340b69">
Oct 25 16:29:39 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 16:29:39 user nova-compute[74048]:         </nova:port>
Oct 25 16:29:39 user nova-compute[74048]:       </nova:ports>
Oct 25 16:29:39 user nova-compute[74048]:     </nova:instance>
Oct 25 16:29:39 user nova-compute[74048]:   </metadata>
Oct 25 16:29:39 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:29:39 user nova-compute[74048]:     <system>
Oct 25 16:29:39 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:29:39 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:29:39 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:29:39 user nova-compute[74048]:       <entry name="serial">1bdfc844-9046-4f08-b276-2eee1d5fc5c3</entry>
Oct 25 16:29:39 user nova-compute[74048]:       <entry name="uuid">1bdfc844-9046-4f08-b276-2eee1d5fc5c3</entry>
Oct 25 16:29:39 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:29:39 user nova-compute[74048]:     </system>
Oct 25 16:29:39 user nova-compute[74048]:   </sysinfo>
Oct 25 16:29:39 user nova-compute[74048]:   <os>
Oct 25 16:29:39 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:29:39 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:29:39 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:29:39 user nova-compute[74048]:   </os>
Oct 25 16:29:39 user nova-compute[74048]:   <features>
Oct 25 16:29:39 user nova-compute[74048]:     <acpi/>
Oct 25 16:29:39 user nova-compute[74048]:     <apic/>
Oct 25 16:29:39 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:29:39 user nova-compute[74048]:   </features>
Oct 25 16:29:39 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:29:39 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:29:39 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:29:39 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:29:39 user nova-compute[74048]:   </clock>
Oct 25 16:29:39 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:29:39 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:29:39 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:29:39 user nova-compute[74048]:   </cpu>
Oct 25 16:29:39 user nova-compute[74048]:   <devices>
Oct 25 16:29:39 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:29:39 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:29:39 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:29:39 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:29:39 user nova-compute[74048]:       <serial>0f82c659-17b7-4d55-a2a5-ddc7172ba044</serial>
Oct 25 16:29:39 user nova-compute[74048]:     </disk>
Oct 25 16:29:39 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:29:39 user nova-compute[74048]:       <mac address="fa:16:3e:72:41:7c"/>
Oct 25 16:29:39 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:29:39 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:29:39 user nova-compute[74048]:       <target dev="tapebbda323-9a"/>
Oct 25 16:29:39 user nova-compute[74048]:     </interface>
Oct 25 16:29:39 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:29:39 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3/console.log" append="off"/>
Oct 25 16:29:39 user nova-compute[74048]:     </serial>
Oct 25 16:29:39 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:29:39 user nova-compute[74048]:     <video>
Oct 25 16:29:39 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:29:39 user nova-compute[74048]:     </video>
Oct 25 16:29:39 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:29:39 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:29:39 user nova-compute[74048]:     </rng>
Oct 25 16:29:39 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:29:39 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:29:39 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:29:39 user nova-compute[74048]:     </memballoon>
Oct 25 16:29:39 user nova-compute[74048]:   </devices>
Oct 25 16:29:39 user nova-compute[74048]: </domain>
Oct 25 16:29:39 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-166486840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382712036',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjjojn8YvnWNnajLosTW7x1rEzFmEFfnM1fIXglgkUuo3CmTU0gSBineq0pi5f4jomsN5QQoXslmxH2A46axyunIDAhWEP2hpfFpWoacytfPoUYSAhxnWVokf1k7zVdXQ==',key_name='tempest-keypair-734782483',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f1265f3be7364d58b49cca5d7b7be97a',ramdisk_id='',reservation_id='r-tw4vdi7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-599396862',owner_user_name='tempest-ServerActionsV293TestJSON-599396862-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0503e1c84bd641b48406fcf9dbdda397',uuid=1bdfc844-9046-4f08-b276-2eee1d5fc5c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converting VIF {"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG os_vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fc670f4-27df-5abb-a37a-83a813bc6ac4', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebbda323-9a, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebbda323-9a, col_values=(('qos', UUID('5c07c639-0fc9-4c87-b617-e8984af60848')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebbda323-9a, col_values=(('external_ids', {'iface-id': 'ebbda323-9a84-4f24-9a1c-6c3359340b69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:41:7c', 'vm-uuid': '1bdfc844-9046-4f08-b276-2eee1d5fc5c3'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:39 user nova-compute[74048]: INFO os_vif [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a')
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] No VIF found with MAC fa:16:3e:72:41:7c, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:39 user nova-compute[74048]: INFO nova.compute.manager [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Terminating instance
Oct 25 16:29:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:29:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-34f6d432-8463-42dc-b118-693b5dce75a5 req-c8b60e26-c462-4b04-81fd-dff9c735b46d service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-unplugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-34f6d432-8463-42dc-b118-693b5dce75a5 req-c8b60e26-c462-4b04-81fd-dff9c735b46d service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-34f6d432-8463-42dc-b118-693b5dce75a5 req-c8b60e26-c462-4b04-81fd-dff9c735b46d service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-34f6d432-8463-42dc-b118-693b5dce75a5 req-c8b60e26-c462-4b04-81fd-dff9c735b46d service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-34f6d432-8463-42dc-b118-693b5dce75a5 req-c8b60e26-c462-4b04-81fd-dff9c735b46d service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-unplugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-34f6d432-8463-42dc-b118-693b5dce75a5 req-c8b60e26-c462-4b04-81fd-dff9c735b46d service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-unplugged-0334d634-48ac-4890-a7cc-a85599ae2cef for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updating instance_info_cache with network_info: [{"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-bb58c025-8dec-4804-9b3e-f42a68e8b5ae" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:29:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Instance destroyed successfully.
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.objects.instance [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lazy-loading 'resources' on Instance uuid 25e59513-b3bb-44c2-ac27-f9dcdacffed1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:25:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1725990459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1725990459',id=5,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI2lNGotJG92Fj94qQDl0ocQfiWigF8za/C96yzaK1pSGQf19zWOaCEmlbnDHxeWnuBGlV2JZPofTBXl7G2u1D98hm4wBsfKCfY1Gg7X1jT84eUokROZBat+dlqQi7r4Q==',key_name='tempest-keypair-1996063576',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7da4a9d7ce314c309771155151f1841d',ramdisk_id='',reservation_id='r-5xdr2wwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1680538480',owner_user_name='tempest-TaggedAttachmentsTest-1680538480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9a5ea3d09a4616b439473e03ec3bab',uuid=25e59513-b3bb-44c2-ac27-f9dcdacffed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converting VIF {"id": "0334d634-48ac-4890-a7cc-a85599ae2cef", "address": "fa:16:3e:96:f9:76", "network": {"id": "4b8de06b-26b1-427f-83f6-c80bff316936", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2038942013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7da4a9d7ce314c309771155151f1841d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0334d634-48", "ovs_interfaceid": "0334d634-48ac-4890-a7cc-a85599ae2cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG os_vif [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0334d634-48, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8212d45-917a-4f70-b754-211f7756c6c5) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: INFO os_vif [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f9:76,bridge_name='br-int',has_traffic_filtering=True,id=0334d634-48ac-4890-a7cc-a85599ae2cef,network=Network(4b8de06b-26b1-427f-83f6-c80bff316936),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0334d634-48')
Oct 25 16:29:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Deleting instance files /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1_del
Oct 25 16:29:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Deletion of /opt/stack/data/nova/instances/25e59513-b3bb-44c2-ac27-f9dcdacffed1_del complete
Oct 25 16:29:41 user nova-compute[74048]: INFO nova.compute.manager [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 25 16:29:41 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:29:42 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Took 1.18 seconds to deallocate network for instance.
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Acquiring lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] No waiting events found dispatching network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:42 user nova-compute[74048]: WARNING nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received unexpected event network-vif-plugged-0334d634-48ac-4890-a7cc-a85599ae2cef for instance with vm_state active and task_state deleting.
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:42 user nova-compute[74048]: WARNING nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:29:42 user nova-compute[74048]: WARNING nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-db9b7b4a-471e-456c-bc79-7eeefefe4eac req-1c27f388-db13-42fc-b92b-d7de5295df88 service nova] [instance: 25e59513-b3bb-44c2-ac27-f9dcdacffed1] Received event network-vif-deleted-0334d634-48ac-4890-a7cc-a85599ae2cef {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:42 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.795s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:43 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Deleted allocations for instance 25e59513-b3bb-44c2-ac27-f9dcdacffed1
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13fa13db-5d80-48ab-9937-00ba69923d2c tempest-TaggedAttachmentsTest-1680538480 tempest-TaggedAttachmentsTest-1680538480-project-member] Lock "25e59513-b3bb-44c2-ac27-f9dcdacffed1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.631s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:29:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance spawned successfully.
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG nova.objects.instance [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74048) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-00262cea-ddd2-4663-81a7-d81ea0b0e4fc tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.121s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd is timed out.
Oct 25 16:29:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Successfully detached device vdb from instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd from the live domain config.
Oct 25 16:29:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlTcZxvB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'd82864e7-21ff-4621-b808-205be1faa6e3'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:29:44 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5431980-7c9c-48c6-b50e-45a04ee3c47e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:29:44 user nova-compute[74048]: No targets found.
Oct 25 16:29:44 user nova-compute[74048]: iSNS:
Oct 25 16:29:44 user nova-compute[74048]: No targets found.
Oct 25 16:29:44 user nova-compute[74048]: STATIC:
Oct 25 16:29:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:29:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:29:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:29:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3
Oct 25 16:29:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:29:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:29:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:29:44 user nova-compute[74048]: FIRMWARE:
Oct 25 16:29:44 user nova-compute[74048]: No targets found.
Oct 25 16:29:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:29:44 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:29:44 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4492a1-1ef0-442e-a7f2-46cba95cef89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b242b34-a915-42c4-98b7-5572cae2329b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:29:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:29:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185024cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3'): ({'sdd'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Removing single pathed devices sdd {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef07ac6-c2a9-47d0-b8ed-fc7faac9b4ce]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08941f66-84db-4b3a-96e6-d2d1ce09ab31]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Flushing IO for device /dev/sdd {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de4589-f7ac-4906-9c70-d74ab738192c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc58a3-8ccb-4f6a-9bd8-3f9c5ac77189]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319872a-5aa1-460d-914f-7e2f10de2d71]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe5156c-5220-4e09-98cf-a889f4fd08cb]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260]
Oct 25 16:29:45 user nova-compute[74048]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3, portal: 172.16.0.220,3260] successful.
Oct 25 16:29:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d82864e7-21ff-4621-b808-205be1faa6e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9bfd2f-43a3-437d-bd5e-6f4aa23f34f0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] <== disconnect_volume: return (406ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:29:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:29:47 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:29:47 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7527MB free_disk=25.614376068115234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 62102eec-d6bd-45d2-a45e-bd90278a34a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4a970e43-ae6e-46fc-a5e7-173012590ca7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 99762562-1e2b-4518-b61c-0acb35949522 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 405bc4c3-4446-45f1-aa47-439e298cdddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:29:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:29:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:29:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lazy-loading 'flavor' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:29:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1a0788c8-d5e0-4a52-9f52-46481c04d8b0 tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.332s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG nova.compute.manager [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-changed-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG nova.compute.manager [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing instance network info cache due to event network-changed-16da64ac-473b-4a8a-9e0d-de230daee02f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] Acquiring lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] Acquired lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG nova.network.neutron [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Refreshing network info cache for port 16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG nova.network.neutron [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updated VIF entry in instance network info cache for port 16da64ac-473b-4a8a-9e0d-de230daee02f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG nova.network.neutron [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8a40461a-8a25-48fe-8235-f580e53faaf1 req-d70884bd-307a-403a-b13d-5d47e4e5d1ce service nova] Releasing lock "refresh_cache-62102eec-d6bd-45d2-a45e-bd90278a34a1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:03 user nova-compute[74048]: INFO nova.compute.manager [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Terminating instance
Oct 25 16:30:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-3288a77e-1726-4e9f-921e-fa06e89dd696 req-b0b7f39b-3e3c-4a80-b5b6-a550436c49db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3288a77e-1726-4e9f-921e-fa06e89dd696 req-b0b7f39b-3e3c-4a80-b5b6-a550436c49db service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3288a77e-1726-4e9f-921e-fa06e89dd696 req-b0b7f39b-3e3c-4a80-b5b6-a550436c49db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3288a77e-1726-4e9f-921e-fa06e89dd696 req-b0b7f39b-3e3c-4a80-b5b6-a550436c49db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-3288a77e-1726-4e9f-921e-fa06e89dd696 req-b0b7f39b-3e3c-4a80-b5b6-a550436c49db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-3288a77e-1726-4e9f-921e-fa06e89dd696 req-b0b7f39b-3e3c-4a80-b5b6-a550436c49db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-16da64ac-473b-4a8a-9e0d-de230daee02f for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-8b59f309-186b-4fb7-9f81-d7a2d78c9d1e req-1fdb13a0-d31b-46e1-bf5e-3bec8d233780 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8b59f309-186b-4fb7-9f81-d7a2d78c9d1e req-1fdb13a0-d31b-46e1-bf5e-3bec8d233780 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8b59f309-186b-4fb7-9f81-d7a2d78c9d1e req-1fdb13a0-d31b-46e1-bf5e-3bec8d233780 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8b59f309-186b-4fb7-9f81-d7a2d78c9d1e req-1fdb13a0-d31b-46e1-bf5e-3bec8d233780 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-8b59f309-186b-4fb7-9f81-d7a2d78c9d1e req-1fdb13a0-d31b-46e1-bf5e-3bec8d233780 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-8b59f309-186b-4fb7-9f81-d7a2d78c9d1e req-1fdb13a0-d31b-46e1-bf5e-3bec8d233780 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-98907da8-b649-4242-9823-bd9f4d8ac7a2 req-f5f211d2-3a2e-4ea6-990a-e4b428a0cf48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-98907da8-b649-4242-9823-bd9f4d8ac7a2 req-f5f211d2-3a2e-4ea6-990a-e4b428a0cf48 service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-98907da8-b649-4242-9823-bd9f4d8ac7a2 req-f5f211d2-3a2e-4ea6-990a-e4b428a0cf48 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-98907da8-b649-4242-9823-bd9f4d8ac7a2 req-f5f211d2-3a2e-4ea6-990a-e4b428a0cf48 service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-98907da8-b649-4242-9823-bd9f4d8ac7a2 req-f5f211d2-3a2e-4ea6-990a-e4b428a0cf48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-98907da8-b649-4242-9823-bd9f4d8ac7a2 req-f5f211d2-3a2e-4ea6-990a-e4b428a0cf48 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-321e2058-c668-430f-8bbd-cd654b7ed753 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Instance destroyed successfully.
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lazy-loading 'resources' on Instance uuid 62102eec-d6bd-45d2-a45e-bd90278a34a1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16da64ac-47, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3811e6ff-ff22-420d-8af4-3c4eeb8d698c) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=16da64ac-473b-4a8a-9e0d-de230daee02f,network=Network(3a378c93-c0c7-4f54-9245-51af3bae1c27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16da64ac-47')
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4845e63d-9d, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cc3b02d-2d0f-42cd-bd36-0197bab79ceb) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:fd:f1,bridge_name='br-int',has_traffic_filtering=True,id=4845e63d-9ded-4e12-9329-8c34f48cf3aa,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4845e63d-9d')
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e3304ef-0e, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da5ffc1e-828d-4743-b10f-26e22119ba51) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:aa:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3304ef-0e')
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0d7ff22-cd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25cd3c42-ceea-43db-8023-f3105f7e1f36) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0d7ff22-cd')
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "321e2058-c668-430f-8bbd-cd654b7ed753", "address": "fa:16:3e:2f:56:a1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap321e2058-c6", "ovs_interfaceid": "321e2058-c668-430f-8bbd-cd654b7ed753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap321e2058-c6, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e39c367c-b542-4624-ba4c-054e5111712b) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:56:a1,bridge_name='br-int',has_traffic_filtering=True,id=321e2058-c668-430f-8bbd-cd654b7ed753,network=Network(dd23481a-e12b-43f7-aa21-9fbf57ccb1d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap321e2058-c6')
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02e9da4d-a4, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70024fd2-a3af-409d-b8f4-f881b925f9da) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9d:34,bridge_name='br-int',has_traffic_filtering=True,id=02e9da4d-a459-499a-9cc6-2b46f90a7e5d,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e9da4d-a4')
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1903933819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1903933819',id=11,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcQScSfSeYPm+KiRogKGjFY1VCrMXCQiAH2alVyhcKyvXXxbDxLeaL3h/gfU5OjVNG0M5xAHVlGd15pNS/jHpsy+WvCyS+LOkYt4hJ1fbQtVIBt4SETtIM8KpT7c0hUkQ==',key_name='tempest-keypair-723936446',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0aedadab87724e0c9a581890f0cccb12',ramdisk_id='',reservation_id='r-g40ydk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-270679145',owner_user_name='tempest-TaggedBootDevicesTest_v242-270679145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70a32b6dc0a247408bdcbd2c9f5e6fc7',uuid=62102eec-d6bd-45d2-a45e-bd90278a34a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converting VIF {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a302c98-fd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d234c6d-ab5a-46db-b0f9-5c11306dc78e) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:06 user nova-compute[74048]: INFO os_vif [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:6b:18,bridge_name='br-int',has_traffic_filtering=True,id=2a302c98-fde0-490f-8ac9-7cd487954e70,network=Network(e3464626-fce9-479f-a6b1-159bc6f16c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a302c98-fd')
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIjDEgrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046ae88-e0f8-479d-bb18-ada36307d6c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]: iSNS:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]: STATIC:
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: FIRMWARE:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:30:06 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:30:06 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37639dc-c0ac-4ffc-8882-8d7b52d172d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39e30c-a6d4-420a-947a-4b22ec61c9a0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185832e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38e9e4-927f-49bb-8774-0b31fba60e8e]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab82618-ec1d-4e57-b897-fbe60e024967]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a9062-32fb-4da3-a605-a994df4a915e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-16da64ac-473b-4a8a-9e0d-de230daee02f for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-dcd821af-f1f7-43d6-aa62-abd7e8b2e2cb req-2557800d-8488-43d0-abf1-01f467a690db service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-02e9da4d-a459-499a-9cc6-2b46f90a7e5d for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6e0f5f-9190-4e9f-9aeb-ae8f1ac179ab]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-4845e63d-9ded-4e12-9329-8c34f48cf3aa for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-2e840394-a773-43a6-a8db-a06e0031a760 req-64b8b90a-c836-4e7d-b9aa-1ece06508dea service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d819ee-f7f2-4b47-b86e-1af6a890ffd1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[80566ad4-42ae-4170-a77d-e8a02cdec370]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260]
Oct 25 16:30:06 user nova-compute[74048]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea, portal: 172.16.0.220,3260] successful.
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ab6feb-5c15-432c-8da9-4b123856f9ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c3070c-7e2a-4fa3-8b2f-14baa31916bb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== disconnect_volume: return (345ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKwJdEpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8e2015-81aa-4bed-a6ea-b03ecca5563c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]: iSNS:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]: STATIC:
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: FIRMWARE:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:30:06 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:30:06 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd7b98-e752-4122-8502-65d51f8f4454]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee77fa08-a4f7-485f-afcc-d6ae2f73ac3e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18580ce0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286'): ({'sdh'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Removing single pathed devices sdh {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16d713-c5c7-4273-8acf-d0ecfd06f722]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b66240-79fc-46ff-9c3d-f8c838912eab]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Flushing IO for device /dev/sdh {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2c0c4-43bf-4192-88c4-c4b8b92e8717]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[64afa56f-762c-4ae7-bee7-997622372f89]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] SCSI volumes sdh have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed319e-cdce-409d-b253-43623d87c269]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-321e2058-c668-430f-8bbd-cd654b7ed753 for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-unplugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-unplugged-2a302c98-fde0-490f-8ac9-7cd487954e70 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Acquiring lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] No waiting events found dispatching network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING nova.compute.manager [req-7fbffd03-5938-4d72-bf62-32a4e68a73d5 req-45c59fcd-f09a-491b-bc45-8129a3f6999c service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received unexpected event network-vif-plugged-2a302c98-fde0-490f-8ac9-7cd487954e70 for instance with vm_state active and task_state deleting.
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd9c12-3313-480e-a71c-dc0ce56c21d1]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260]
Oct 25 16:30:06 user nova-compute[74048]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286, portal: 172.16.0.220,3260] successful.
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43b1a248-a4da-4e54-8a17-812e5c148286 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd2f27f-8ec8-478e-8576-480952fc5fa9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== disconnect_volume: return (312ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alJdozIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:06 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d8df7f-1672-4ffe-b648-c95e066a1216]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]: iSNS:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]: STATIC:
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:30:06 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:06 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:06 user nova-compute[74048]: FIRMWARE:
Oct 25 16:30:06 user nova-compute[74048]: No targets found.
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:30:06 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:30:06 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[359dec86-2837-465e-bf7c-2f549aadc469]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[396752a1-9161-41cd-9840-0e4121f7ece5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185832c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3'): ({'sdi'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Removing single pathed devices sdi {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[30345072-f6cb-4221-bd72-d7c03279d38a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a572c25f-fb2e-4415-b57b-0d0f64e49972]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Flushing IO for device /dev/sdi {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b929197e-3a8c-488b-a080-98af4f9cae17]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7418c02-6f19-4ace-833c-602021b41cec]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] SCSI volumes sdi have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02771581-3b14-4a8c-a57f-fab68795889a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e052a-fa17-416b-9238-60e3869084b6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260]
Oct 25 16:30:06 user nova-compute[74048]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3, portal: 172.16.0.220,3260] successful.
Oct 25 16:30:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac9471b-1410-45c7-906a-d94ba898b1d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75ecb37-0a63-4d80-82db-1ceda1668b07]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] <== disconnect_volume: return (286ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:30:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Deleting instance files /opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1_del
Oct 25 16:30:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Deletion of /opt/stack/data/nova/instances/62102eec-d6bd-45d2-a45e-bd90278a34a1_del complete
Oct 25 16:30:07 user nova-compute[74048]: INFO nova.compute.manager [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Took 3.37 seconds to destroy the instance on the hypervisor.
Oct 25 16:30:07 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:30:07 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:30:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-4122a9a8-ce60-4f6f-8579-62f6308fa099 req-c735420f-7176-4131-8ec6-5d66d8347eb1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-deleted-321e2058-c668-430f-8bbd-cd654b7ed753 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:08 user nova-compute[74048]: INFO nova.compute.manager [req-4122a9a8-ce60-4f6f-8579-62f6308fa099 req-c735420f-7176-4131-8ec6-5d66d8347eb1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Neutron deleted interface 321e2058-c668-430f-8bbd-cd654b7ed753; detaching it from the instance and deleting it from the info cache
Oct 25 16:30:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-4122a9a8-ce60-4f6f-8579-62f6308fa099 req-c735420f-7176-4131-8ec6-5d66d8347eb1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [{"id": "16da64ac-473b-4a8a-9e0d-de230daee02f", "address": "fa:16:3e:9d:42:d2", "network": {"id": "3a378c93-c0c7-4f54-9245-51af3bae1c27", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-276463616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16da64ac-47", "ovs_interfaceid": "16da64ac-473b-4a8a-9e0d-de230daee02f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "address": "fa:16:3e:45:fd:f1", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4845e63d-9d", "ovs_interfaceid": "4845e63d-9ded-4e12-9329-8c34f48cf3aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "address": "fa:16:3e:33:aa:aa", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3304ef-0e", "ovs_interfaceid": "1e3304ef-0eb9-4767-b1e5-8a01ac8e8d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "address": "fa:16:3e:81:5d:be", "network": {"id": "dd23481a-e12b-43f7-aa21-9fbf57ccb1d4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1896758497", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0d7ff22-cd", "ovs_interfaceid": "e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "address": "fa:16:3e:8e:9d:34", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e9da4d-a4", "ovs_interfaceid": "02e9da4d-a459-499a-9cc6-2b46f90a7e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a302c98-fde0-490f-8ac9-7cd487954e70", "address": "fa:16:3e:8e:6b:18", "network": {"id": "e3464626-fce9-479f-a6b1-159bc6f16c04", "bridge": "br-int", "label": "tempest-device-tagging-net2-1419190477", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0aedadab87724e0c9a581890f0cccb12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a302c98-fd", "ovs_interfaceid": "2a302c98-fde0-490f-8ac9-7cd487954e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-4122a9a8-ce60-4f6f-8579-62f6308fa099 req-c735420f-7176-4131-8ec6-5d66d8347eb1 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Detach interface failed, port_id=321e2058-c668-430f-8bbd-cd654b7ed753, reason: Instance 62102eec-d6bd-45d2-a45e-bd90278a34a1 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:30:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:10 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:10 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Took 3.78 seconds to deallocate network for instance.
Oct 25 16:30:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec71edf-6c4d-4664-8573-35f34111e152 req-f85ab4a7-b5d5-457e-a655-9c93952646e5 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-deleted-2a302c98-fde0-490f-8ac9-7cd487954e70 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec71edf-6c4d-4664-8573-35f34111e152 req-f85ab4a7-b5d5-457e-a655-9c93952646e5 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-deleted-02e9da4d-a459-499a-9cc6-2b46f90a7e5d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec71edf-6c4d-4664-8573-35f34111e152 req-f85ab4a7-b5d5-457e-a655-9c93952646e5 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-deleted-e0d7ff22-cdb2-4186-8f21-c8a347f1b1bc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-aec71edf-6c4d-4664-8573-35f34111e152 req-f85ab4a7-b5d5-457e-a655-9c93952646e5 service nova] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Received event network-vif-deleted-16da64ac-473b-4a8a-9e0d-de230daee02f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:13 user nova-compute[74048]: INFO nova.compute.manager [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] [instance: 62102eec-d6bd-45d2-a45e-bd90278a34a1] Took 2.91 seconds to detach 3 volumes for instance.
Oct 25 16:30:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:14 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:30:14 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:30:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:14 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Deleted allocations for instance 62102eec-d6bd-45d2-a45e-bd90278a34a1
Oct 25 16:30:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b72deb8e-a9b0-43df-a736-174c5aa7b1db tempest-TaggedBootDevicesTest_v242-270679145 tempest-TaggedBootDevicesTest_v242-270679145-project-member] Lock "62102eec-d6bd-45d2-a45e-bd90278a34a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.702s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:15 user nova-compute[74048]: INFO nova.compute.manager [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Terminating instance
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-a8578046-89cf-4d57-a25c-df82b0e09251 req-c48b31e2-f992-4988-aca2-bf66368ee269 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-vif-unplugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a8578046-89cf-4d57-a25c-df82b0e09251 req-c48b31e2-f992-4988-aca2-bf66368ee269 service nova] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a8578046-89cf-4d57-a25c-df82b0e09251 req-c48b31e2-f992-4988-aca2-bf66368ee269 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a8578046-89cf-4d57-a25c-df82b0e09251 req-c48b31e2-f992-4988-aca2-bf66368ee269 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-a8578046-89cf-4d57-a25c-df82b0e09251 req-c48b31e2-f992-4988-aca2-bf66368ee269 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] No waiting events found dispatching network-vif-unplugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-a8578046-89cf-4d57-a25c-df82b0e09251 req-c48b31e2-f992-4988-aca2-bf66368ee269 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-vif-unplugged-f5b2bbce-032c-4680-9643-6ee17f25816e for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:15 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Instance destroyed successfully.
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lazy-loading 'resources' on Instance uuid 4ae1fcb2-fa7f-44f5-8661-1271668567bd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1712251345',display_name='tempest-TestVolumeSwap-server-1712251345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1712251345',id=8,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXQlZGjrW/f34uOrSiiBeZ0doFTQi2ynS+Mwbfd5t8xJ12gCz+0D7mHdNpffSD/rxApumjqU6E3d7hl4QyRiTjyGSo4rPY71Ep8UtWQxHiutt3RRg0NMNwfgFfMsR0yBQ==',key_name='tempest-keypair-529919492',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c5b6a583ea94bf18bb0100d3f49b9c2',ramdisk_id='',reservation_id='r-tutun10k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-205005956',owner_user_name='tempest-TestVolumeSwap-205005956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2248c3eb174326a6d08330d16835ea',uuid=4ae1fcb2-fa7f-44f5-8661-1271668567bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Converting VIF {"id": "f5b2bbce-032c-4680-9643-6ee17f25816e", "address": "fa:16:3e:b9:3a:9c", "network": {"id": "08729b19-06e2-4035-87c2-c421d8730717", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1325677980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c5b6a583ea94bf18bb0100d3f49b9c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b2bbce-03", "ovs_interfaceid": "f5b2bbce-032c-4680-9643-6ee17f25816e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG os_vif [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5b2bbce-03, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c05ebc27-be3c-462e-8a25-7c1c7337fd81) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:15 user nova-compute[74048]: INFO os_vif [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:3a:9c,bridge_name='br-int',has_traffic_filtering=True,id=f5b2bbce-032c-4680-9643-6ee17f25816e,network=Network(08729b19-06e2-4035-87c2-c421d8730717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b2bbce-03')
Oct 25 16:30:15 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Deleting instance files /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd_del
Oct 25 16:30:15 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Deletion of /opt/stack/data/nova/instances/4ae1fcb2-fa7f-44f5-8661-1271668567bd_del complete
Oct 25 16:30:15 user nova-compute[74048]: INFO nova.compute.manager [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 16:30:16 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:30:16 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:30:16 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:30:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-45598be6-ae4b-4f3d-b1dd-e08d0ce3f44a req-cf4954d9-ed94-4db4-bf52-81922951fff7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45598be6-ae4b-4f3d-b1dd-e08d0ce3f44a req-cf4954d9-ed94-4db4-bf52-81922951fff7 service nova] Acquiring lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45598be6-ae4b-4f3d-b1dd-e08d0ce3f44a req-cf4954d9-ed94-4db4-bf52-81922951fff7 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45598be6-ae4b-4f3d-b1dd-e08d0ce3f44a req-cf4954d9-ed94-4db4-bf52-81922951fff7 service nova] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-45598be6-ae4b-4f3d-b1dd-e08d0ce3f44a req-cf4954d9-ed94-4db4-bf52-81922951fff7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] No waiting events found dispatching network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:17 user nova-compute[74048]: WARNING nova.compute.manager [req-45598be6-ae4b-4f3d-b1dd-e08d0ce3f44a req-cf4954d9-ed94-4db4-bf52-81922951fff7 service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received unexpected event network-vif-plugged-f5b2bbce-032c-4680-9643-6ee17f25816e for instance with vm_state active and task_state deleting.
Oct 25 16:30:18 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:18 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Took 2.21 seconds to deallocate network for instance.
Oct 25 16:30:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-864e0c37-7a55-4aeb-804f-34e33f5501a3 req-4e6a0932-cf7e-4c97-a784-3affad4a866c service nova] [instance: 4ae1fcb2-fa7f-44f5-8661-1271668567bd] Received event network-vif-deleted-f5b2bbce-032c-4680-9643-6ee17f25816e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:18 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:30:18 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:30:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:18 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Deleted allocations for instance 4ae1fcb2-fa7f-44f5-8661-1271668567bd
Oct 25 16:30:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4515ea48-321a-4d43-b23d-22c69c1fde7a tempest-TestVolumeSwap-205005956 tempest-TestVolumeSwap-205005956-project-member] Lock "4ae1fcb2-fa7f-44f5-8661-1271668567bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.686s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-changed-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Refreshing instance network info cache due to event network-changed-56d3478b-943a-4c3b-9864-0b6e4c519e4a. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] Acquiring lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] Acquired lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG nova.network.neutron [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Refreshing network info cache for port 56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG nova.network.neutron [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updated VIF entry in instance network info cache for port 56d3478b-943a-4c3b-9864-0b6e4c519e4a. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG nova.network.neutron [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d48d1307-80d6-46e7-b633-d1ac046f2736 req-33183223-45f9-40cb-8071-9633d88592ec service nova] Releasing lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'flavor' on Instance uuid 4a970e43-ae6e-46fc-a5e7-173012590ca7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:24 user nova-compute[74048]: INFO nova.compute.manager [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Attaching volume 4df2d27b-827d-4abc-a28c-f2d5c1cf954b to /dev/vdb
Oct 25 16:30:24 user nova-compute[74048]: DEBUG os_brick.utils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd15bc8-1c34-449a-ae69-37141f34066d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a39b4c-c515-4b72-890c-53c75b95a675]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d307f3-0154-4fb8-8877-e7b2d69f1fa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2837223-6f7c-41c1-896a-ab057fbdcb42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:30:24 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:30:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22a5b2-e00f-4473-a1b2-82f63ef8f474]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG os_brick.utils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating existing volume attachment record: f2197e23-5b85-4332-9be4-4f43b2334a3a {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:30:28 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:30:30 user nova-compute[74048]: INFO nova.compute.claims [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Claim successful on node user
Oct 25 16:30:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:30:31 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.policy [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90163fcc508143cc867e2c9e1cac5818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e13c71cbaec42c0bed605da609fa4da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:30:31 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Creating image(s)
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "/opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "/opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.258s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk 1073741824" returned: 0 in 0.065s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Cannot resize image /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Ensure instance console log exists: /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Successfully created port: 6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:30:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Successfully updated port: 6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquired lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-changed-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Refreshing instance network info cache due to event network-changed-6f95b356-29b3-4197-b96c-4d43b769bef8. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] Acquiring lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updating instance_info_cache with network_info: [{"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Releasing lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Instance network_info: |[{"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] Acquired lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Refreshing network info cache for port 6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:30:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Start _get_guest_xml network_info=[{"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:30:34 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:30:34 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6565173',id=15,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQu8qUFmQkJq3k3ZBwop1cSeIhsygJxM3z946w3jOLMFSv59ND2k/6VHaK9gtWrq1L1miVwNbTTTPdmP/TfVfkwxfnG+o+5dk+WywDY6o9bCVrSXd2nNElON8Bhu25siw==',key_name='tempest-keypair-1692789204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e13c71cbaec42c0bed605da609fa4da',ramdisk_id='',reservation_id='r-b03ffkud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1383948749',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90163fcc508143cc867e2c9e1cac5818',uuid=a2a7443a-c48d-45f0-a7d3-829931f50ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Converting VIF {"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.objects.instance [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lazy-loading 'pci_devices' on Instance uuid a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:30:34 user nova-compute[74048]:   <uuid>a2a7443a-c48d-45f0-a7d3-829931f50ce6</uuid>
Oct 25 16:30:34 user nova-compute[74048]:   <name>instance-0000000f</name>
Oct 25 16:30:34 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:30:34 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:30:34 user nova-compute[74048]:   <metadata>
Oct 25 16:30:34 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:30:34 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:30:34 user nova-compute[74048]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393</nova:name>
Oct 25 16:30:34 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:30:34</nova:creationTime>
Oct 25 16:30:34 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:30:34 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:30:34 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:30:34 user nova-compute[74048]:       <nova:owner>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:user uuid="90163fcc508143cc867e2c9e1cac5818">tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member</nova:user>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:project uuid="0e13c71cbaec42c0bed605da609fa4da">tempest-TestServerVolumeAttachScenarioOldVersion-1383948749</nova:project>
Oct 25 16:30:34 user nova-compute[74048]:       </nova:owner>
Oct 25 16:30:34 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:30:34 user nova-compute[74048]:       <nova:ports>
Oct 25 16:30:34 user nova-compute[74048]:         <nova:port uuid="6f95b356-29b3-4197-b96c-4d43b769bef8">
Oct 25 16:30:34 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 16:30:34 user nova-compute[74048]:         </nova:port>
Oct 25 16:30:34 user nova-compute[74048]:       </nova:ports>
Oct 25 16:30:34 user nova-compute[74048]:     </nova:instance>
Oct 25 16:30:34 user nova-compute[74048]:   </metadata>
Oct 25 16:30:34 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:30:34 user nova-compute[74048]:     <system>
Oct 25 16:30:34 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:30:34 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:30:34 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:30:34 user nova-compute[74048]:       <entry name="serial">a2a7443a-c48d-45f0-a7d3-829931f50ce6</entry>
Oct 25 16:30:34 user nova-compute[74048]:       <entry name="uuid">a2a7443a-c48d-45f0-a7d3-829931f50ce6</entry>
Oct 25 16:30:34 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:30:34 user nova-compute[74048]:     </system>
Oct 25 16:30:34 user nova-compute[74048]:   </sysinfo>
Oct 25 16:30:34 user nova-compute[74048]:   <os>
Oct 25 16:30:34 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:30:34 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:30:34 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:30:34 user nova-compute[74048]:   </os>
Oct 25 16:30:34 user nova-compute[74048]:   <features>
Oct 25 16:30:34 user nova-compute[74048]:     <acpi/>
Oct 25 16:30:34 user nova-compute[74048]:     <apic/>
Oct 25 16:30:34 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:30:34 user nova-compute[74048]:   </features>
Oct 25 16:30:34 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:30:34 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:30:34 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:30:34 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:30:34 user nova-compute[74048]:   </clock>
Oct 25 16:30:34 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:30:34 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:30:34 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:30:34 user nova-compute[74048]:   </cpu>
Oct 25 16:30:34 user nova-compute[74048]:   <devices>
Oct 25 16:30:34 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:30:34 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:30:34 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk"/>
Oct 25 16:30:34 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:30:34 user nova-compute[74048]:     </disk>
Oct 25 16:30:34 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:30:34 user nova-compute[74048]:       <mac address="fa:16:3e:4d:d1:60"/>
Oct 25 16:30:34 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:30:34 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:30:34 user nova-compute[74048]:       <target dev="tap6f95b356-29"/>
Oct 25 16:30:34 user nova-compute[74048]:     </interface>
Oct 25 16:30:34 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:30:34 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/console.log" append="off"/>
Oct 25 16:30:34 user nova-compute[74048]:     </serial>
Oct 25 16:30:34 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:30:34 user nova-compute[74048]:     <video>
Oct 25 16:30:34 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:30:34 user nova-compute[74048]:     </video>
Oct 25 16:30:34 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:30:34 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:30:34 user nova-compute[74048]:     </rng>
Oct 25 16:30:34 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:30:34 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:30:34 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:30:34 user nova-compute[74048]:     </memballoon>
Oct 25 16:30:34 user nova-compute[74048]:   </devices>
Oct 25 16:30:34 user nova-compute[74048]: </domain>
Oct 25 16:30:34 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6565173',id=15,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQu8qUFmQkJq3k3ZBwop1cSeIhsygJxM3z946w3jOLMFSv59ND2k/6VHaK9gtWrq1L1miVwNbTTTPdmP/TfVfkwxfnG+o+5dk+WywDY6o9bCVrSXd2nNElON8Bhu25siw==',key_name='tempest-keypair-1692789204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e13c71cbaec42c0bed605da609fa4da',ramdisk_id='',reservation_id='r-b03ffkud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1383948749',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90163fcc508143cc867e2c9e1cac5818',uuid=a2a7443a-c48d-45f0-a7d3-829931f50ce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Converting VIF {"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG os_vif [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd78113b4-11b3-550f-9498-c810158faea0', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f95b356-29, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f95b356-29, col_values=(('qos', UUID('fdd40eb6-3864-4804-8e11-b708c72130d6')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f95b356-29, col_values=(('external_ids', {'iface-id': '6f95b356-29b3-4197-b96c-4d43b769bef8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:d1:60', 'vm-uuid': 'a2a7443a-c48d-45f0-a7d3-829931f50ce6'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:34 user nova-compute[74048]: INFO os_vif [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29')
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] No VIF found with MAC fa:16:3e:4d:d1:60, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updated VIF entry in instance network info cache for port 6f95b356-29b3-4197-b96c-4d43b769bef8. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updating instance_info_cache with network_info: [{"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-56e02191-a2e7-4d01-b683-de305f9d6b21 req-8d727a1b-1cf0-4576-a670-20852a1576ab service nova] Releasing lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-c431c7be-55fb-415b-8174-22ddd08cc96a req-89defdcf-6e04-442c-865d-3aae0940f3d6 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c431c7be-55fb-415b-8174-22ddd08cc96a req-89defdcf-6e04-442c-865d-3aae0940f3d6 service nova] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c431c7be-55fb-415b-8174-22ddd08cc96a req-89defdcf-6e04-442c-865d-3aae0940f3d6 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c431c7be-55fb-415b-8174-22ddd08cc96a req-89defdcf-6e04-442c-865d-3aae0940f3d6 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-c431c7be-55fb-415b-8174-22ddd08cc96a req-89defdcf-6e04-442c-865d-3aae0940f3d6 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] No waiting events found dispatching network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:36 user nova-compute[74048]: WARNING nova.compute.manager [req-c431c7be-55fb-415b-8174-22ddd08cc96a req-89defdcf-6e04-442c-865d-3aae0940f3d6 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received unexpected event network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 for instance with vm_state building and task_state spawning.
Oct 25 16:30:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-f93041e2-40de-4baa-b558-be18e4f5c27d req-28ab153a-759d-4f37-b8e5-1935224c71b7 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f93041e2-40de-4baa-b558-be18e4f5c27d req-28ab153a-759d-4f37-b8e5-1935224c71b7 service nova] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f93041e2-40de-4baa-b558-be18e4f5c27d req-28ab153a-759d-4f37-b8e5-1935224c71b7 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f93041e2-40de-4baa-b558-be18e4f5c27d req-28ab153a-759d-4f37-b8e5-1935224c71b7 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-f93041e2-40de-4baa-b558-be18e4f5c27d req-28ab153a-759d-4f37-b8e5-1935224c71b7 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] No waiting events found dispatching network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:38 user nova-compute[74048]: WARNING nova.compute.manager [req-f93041e2-40de-4baa-b558-be18e4f5c27d req-28ab153a-759d-4f37-b8e5-1935224c71b7 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received unexpected event network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 for instance with vm_state building and task_state spawning.
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:30:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Instance spawned successfully.
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:30:38 user nova-compute[74048]: INFO nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Took 6.73 seconds to spawn the instance on the hypervisor.
Oct 25 16:30:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:30:38 user nova-compute[74048]: INFO nova.compute.manager [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Took 7.75 seconds to build instance.
Oct 25 16:30:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7ff08eec-4e77-4d7b-a1cd-eb085bde1b19 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.869s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 4a970e43-ae6e-46fc-a5e7-173012590ca7 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 99762562-1e2b-4518-b61c-0acb35949522 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 405bc4c3-4446-45f1-aa47-439e298cdddd {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "99762562-1e2b-4518-b61c-0acb35949522" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "99762562-1e2b-4518-b61c-0acb35949522" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.173s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.194s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.202s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.211s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-changed-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Refreshing instance network info cache due to event network-changed-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] Acquiring lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] Acquired lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:30:40 user nova-compute[74048]: DEBUG nova.network.neutron [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Refreshing network info cache for port e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG nova.network.neutron [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updated VIF entry in instance network info cache for port e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG nova.network.neutron [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updating instance_info_cache with network_info: [{"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e8696d2f-ec4c-437b-9f55-1e67fd8eaf87 req-86603a8d-7b14-4ed2-a4d5-e5bc023e3398 service nova] Releasing lock "refresh_cache-99762562-1e2b-4518-b61c-0acb35949522" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:41 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAjPEKzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:45 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:45 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:45 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b1e70-8869-4e93-8bea-7883833a80de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:30:45 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef2aad-0e50-497f-9b80-c8fc952ba229]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b] added
Oct 25 16:30:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e20644-3758-4253-8d50-40a0b95883f4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13439b3-ee35-430e-9973-d41e096ada78]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAjPEKzh {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAjPEKzh" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112c3ba-f139-449f-a9d7-b1c0ebec8c5b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAjPEKzh'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[389faabd-64d1-45a9-96da-2ce1c27bff9c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f9e60-9a03-45d3-8ad3-adabb32f2a14]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f3cce-ac32-4e69-9b74-e08319d8f388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260]
Oct 25 16:30:45 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260] successful.
Oct 25 16:30:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d689d-4463-44b3-961f-2f6365e91209]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d10b4f-842e-42c9-b830-a15057f9cc4d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:45 user nova-compute[74048]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b (non-flash)
Oct 25 16:30:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:45 user nova-compute[74048]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b (non-flash)
Oct 25 16:30:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7151ea8-d331-4721-9f83-97ab5872df58]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:30:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAjPEKzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26336643035613564', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336643035613564', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:30:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'flavor' on Instance uuid 4a970e43-ae6e-46fc-a5e7-173012590ca7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:30:47 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:30:47 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:30:47 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:30:47 user nova-compute[74048]:   <serial>4df2d27b-827d-4abc-a28c-f2d5c1cf954b</serial>
Oct 25 16:30:47 user nova-compute[74048]: </disk>
Oct 25 16:30:47 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:30:47 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:30:47 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:30:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.645645141601562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:30:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 99762562-1e2b-4518-b61c-0acb35949522 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 4a970e43-ae6e-46fc-a5e7-173012590ca7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 99762562-1e2b-4518-b61c-0acb35949522 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 405bc4c3-4446-45f1-aa47-439e298cdddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No VIF found with MAC fa:16:3e:b6:87:5d, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:48 user nova-compute[74048]: INFO nova.compute.manager [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Attaching volume 2f62348a-0f28-4b67-b132-b6efbeb1188c to /dev/vdb
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9f8960ad-b335-4e59-a3d3-49bd8702d8d5 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.239s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.493s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG os_brick.utils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e9937-7318-4155-8de1-8a0814fc553d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a93a68-4c13-40d6-afcc-33412411ae3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db6a8fe-184b-4dc4-88cb-5c01889bab80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0182faa0-5254-457c-a57b-6806f77f0c97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:30:48 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d993f0db-dcd3-4f09-a322-789eb47f5faa]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG os_brick.utils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updating existing volume attachment record: f283a85b-6ad0-48c2-95fa-2790986a4c02 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:30:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.203s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:50 user nova-compute[74048]: INFO nova.compute.manager [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Rebuilding instance
Oct 25 16:30:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:30:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance destroyed successfully.
Oct 25 16:30:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-273c4ecc-f342-432d-99a9-be3645515d72 req-125cbfb0-85ed-4f5e-94ff-f444ba82f05e service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-vif-unplugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-273c4ecc-f342-432d-99a9-be3645515d72 req-125cbfb0-85ed-4f5e-94ff-f444ba82f05e service nova] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-273c4ecc-f342-432d-99a9-be3645515d72 req-125cbfb0-85ed-4f5e-94ff-f444ba82f05e service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-273c4ecc-f342-432d-99a9-be3645515d72 req-125cbfb0-85ed-4f5e-94ff-f444ba82f05e service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-273c4ecc-f342-432d-99a9-be3645515d72 req-125cbfb0-85ed-4f5e-94ff-f444ba82f05e service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] No waiting events found dispatching network-vif-unplugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:51 user nova-compute[74048]: WARNING nova.compute.manager [req-273c4ecc-f342-432d-99a9-be3645515d72 req-125cbfb0-85ed-4f5e-94ff-f444ba82f05e service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received unexpected event network-vif-unplugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a for instance with vm_state active and task_state rebuilding.
Oct 25 16:30:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:51 user nova-compute[74048]: INFO nova.compute.manager [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Detaching volume 4df2d27b-827d-4abc-a28c-f2d5c1cf954b
Oct 25 16:30:52 user nova-compute[74048]: INFO nova.virt.block_device [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Attempting to driver detach volume 4df2d27b-827d-4abc-a28c-f2d5c1cf954b from mountpoint /dev/vdb
Oct 25 16:30:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Attempting to detach device vdb from instance 4a970e43-ae6e-46fc-a5e7-173012590ca7 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:30:52 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:30:52 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:30:52 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:30:52 user nova-compute[74048]:   <serial>4df2d27b-827d-4abc-a28c-f2d5c1cf954b</serial>
Oct 25 16:30:52 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:30:52 user nova-compute[74048]: </disk>
Oct 25 16:30:52 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:30:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully detached device vdb from instance 4a970e43-ae6e-46fc-a5e7-173012590ca7 from the persistent domain config.
Oct 25 16:30:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAjPEKzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:52 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc32de-13dc-4744-9812-e2db79b8c14d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:30:52 user nova-compute[74048]: No targets found.
Oct 25 16:30:52 user nova-compute[74048]: iSNS:
Oct 25 16:30:52 user nova-compute[74048]: No targets found.
Oct 25 16:30:52 user nova-compute[74048]: STATIC:
Oct 25 16:30:52 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b
Oct 25 16:30:52 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:52 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:52 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:30:52 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:52 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:52 user nova-compute[74048]: FIRMWARE:
Oct 25 16:30:52 user nova-compute[74048]: No targets found.
Oct 25 16:30:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:30:52 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:30:52 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[83477325-b986-4f61-92c0-6a35e5196ba1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[879248f8-4bc9-429f-b1f0-1e6b5a105691]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:52 user nova-compute[74048]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b (non-flash)
Oct 25 16:30:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:52 user nova-compute[74048]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b (non-flash)
Oct 25 16:30:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184053da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df6158-ecac-4893-b193-f56ff4dc92ed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df589a-593a-434e-999f-9ee5aa016700]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[923bd5b8-c80c-4fa8-9845-7f0de56da60e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887946d-9989-406a-a4e4-0c40623f3b18]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[147abb5e-5fc2-4740-9c96-2c61d19af742]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643686f-6da4-4509-8325-587182685f73]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260]
Oct 25 16:30:52 user nova-compute[74048]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b, portal: 172.16.0.220,3260] successful.
Oct 25 16:30:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f80ae9-10be-438a-b295-dc3709560eb3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== disconnect_volume: return (320ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:30:53 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance destroyed successfully.
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127080201',display_name='tempest-ServerActionsTestOtherA-server-2116857339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127080201',id=12,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF/Ob8zVZV2VbmuGOLtxWdy/S5pTQppE8p4hDAWaGtFkeEynINdBiyI+HYRih4nviB5WYM5HaOiWdBqdpoYiqM9tKvfSHL3HINtv/rMFMfN2/npkh4X3j7Ak4lcCS9t0w==',key_name='tempest-keypair-204708746',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-30sp9xr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:30:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=4a970e43-ae6e-46fc-a5e7-173012590ca7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_vif [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d3478b-94, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3dff6d0-242e-4a06-a0aa-45d5f92b7866) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:53 user nova-compute[74048]: INFO os_vif [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94')
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAjPEKzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:53 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5100499-2509-4ca7-9af6-ba651ee9b55b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:30:53 user nova-compute[74048]: No targets found.
Oct 25 16:30:53 user nova-compute[74048]: iSNS:
Oct 25 16:30:53 user nova-compute[74048]: No targets found.
Oct 25 16:30:53 user nova-compute[74048]: STATIC:
Oct 25 16:30:53 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:30:53 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:53 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:53 user nova-compute[74048]: FIRMWARE:
Oct 25 16:30:53 user nova-compute[74048]: No targets found.
Oct 25 16:30:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:30:53 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:30:53 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-8fb528c2-a948-44cb-a134-6712c925c0c8 req-18cf9117-2f4b-4f80-a938-6b3a46c04980 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8fb528c2-a948-44cb-a134-6712c925c0c8 req-18cf9117-2f4b-4f80-a938-6b3a46c04980 service nova] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8fb528c2-a948-44cb-a134-6712c925c0c8 req-18cf9117-2f4b-4f80-a938-6b3a46c04980 service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8fb528c2-a948-44cb-a134-6712c925c0c8 req-18cf9117-2f4b-4f80-a938-6b3a46c04980 service nova] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-8fb528c2-a948-44cb-a134-6712c925c0c8 req-18cf9117-2f4b-4f80-a938-6b3a46c04980 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] No waiting events found dispatching network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:53 user nova-compute[74048]: WARNING nova.compute.manager [req-8fb528c2-a948-44cb-a134-6712c925c0c8 req-18cf9117-2f4b-4f80-a938-6b3a46c04980 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received unexpected event network-vif-plugged-56d3478b-943a-4c3b-9864-0b6e4c519e4a for instance with vm_state active and task_state rebuilding.
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab659d0-fe60-4f27-b3e1-ec1755dc246d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[827da3e6-3161-4c7f-a4ec-3732c1b32de6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184055f370>, {}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Disconnecting from: [] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== disconnect_volume: return (81ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:30:53 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Deleting instance files /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7_del
Oct 25 16:30:53 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Deletion of /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7_del complete
Oct 25 16:30:53 user nova-compute[74048]: INFO nova.virt.block_device [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Booting with volume 4df2d27b-827d-4abc-a28c-f2d5c1cf954b at /dev/vdb
Oct 25 16:30:53 user nova-compute[74048]: DEBUG os_brick.utils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[25de02ef-bd27-487b-aa2b-da9186b8dd79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c936d-3d47-4e39-b351-958a39952e95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b99cc-f404-40c2-91b8-5bc94bd1eaac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5528645a-0bf0-46ae-b8d1-2d46aeb8c0a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:30:54 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:30:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0b9156-bb94-404d-b471-9504629d98b7]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG os_brick.utils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:54 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating existing volume attachment record: 94a5da90-3a6c-4fb2-a065-49c2f3dbab42 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:30:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:58 user nova-compute[74048]: INFO nova.compute.manager [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Terminating instance
Oct 25 16:30:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-0b89b054-20cf-4d2b-acae-daedbfe3d3d0 req-e34bda61-6e43-4e8a-892f-486bbe2a9819 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-unplugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0b89b054-20cf-4d2b-acae-daedbfe3d3d0 req-e34bda61-6e43-4e8a-892f-486bbe2a9819 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0b89b054-20cf-4d2b-acae-daedbfe3d3d0 req-e34bda61-6e43-4e8a-892f-486bbe2a9819 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0b89b054-20cf-4d2b-acae-daedbfe3d3d0 req-e34bda61-6e43-4e8a-892f-486bbe2a9819 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-0b89b054-20cf-4d2b-acae-daedbfe3d3d0 req-e34bda61-6e43-4e8a-892f-486bbe2a9819 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-unplugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:30:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-0b89b054-20cf-4d2b-acae-daedbfe3d3d0 req-e34bda61-6e43-4e8a-892f-486bbe2a9819 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-unplugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:30:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Instance destroyed successfully.
Oct 25 16:30:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lazy-loading 'resources' on Instance uuid 1bdfc844-9046-4f08-b276-2eee1d5fc5c3 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-166486840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-382712036',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjjojn8YvnWNnajLosTW7x1rEzFmEFfnM1fIXglgkUuo3CmTU0gSBineq0pi5f4jomsN5QQoXslmxH2A46axyunIDAhWEP2hpfFpWoacytfPoUYSAhxnWVokf1k7zVdXQ==',key_name='tempest-keypair-734782483',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1265f3be7364d58b49cca5d7b7be97a',ramdisk_id='',reservation_id='r-tw4vdi7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-599396862',owner_user_name='tempest-ServerActionsV293TestJSON-599396862-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0503e1c84bd641b48406fcf9dbdda397',uuid=1bdfc844-9046-4f08-b276-2eee1d5fc5c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converting VIF {"id": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "address": "fa:16:3e:72:41:7c", "network": {"id": "6e83e5ae-f549-45eb-83f0-bc9a1fcde6be", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1006521951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1265f3be7364d58b49cca5d7b7be97a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebbda323-9a", "ovs_interfaceid": "ebbda323-9a84-4f24-9a1c-6c3359340b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_vif [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebbda323-9a, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c07c639-0fc9-4c87-b617-e8984af60848) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:30:59 user nova-compute[74048]: INFO os_vif [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:41:7c,bridge_name='br-int',has_traffic_filtering=True,id=ebbda323-9a84-4f24-9a1c-6c3359340b69,network=Network(6e83e5ae-f549-45eb-83f0-bc9a1fcde6be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebbda323-9a')
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsEtyDxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:30:59 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa0237-8057-42a5-ad33-80cac0173109]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:30:59 user nova-compute[74048]: No targets found.
Oct 25 16:30:59 user nova-compute[74048]: iSNS:
Oct 25 16:30:59 user nova-compute[74048]: No targets found.
Oct 25 16:30:59 user nova-compute[74048]: STATIC:
Oct 25 16:30:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044
Oct 25 16:30:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:30:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:30:59 user nova-compute[74048]: FIRMWARE:
Oct 25 16:30:59 user nova-compute[74048]: No targets found.
Oct 25 16:30:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:30:59 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:30:59 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532e4d1-2b1c-4967-aea3-4552e520730b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad74f44a-067a-471e-afd6-e7121c4c119c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 (non-flash)
Oct 25 16:30:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840585e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17558fd0-906a-4dda-8f31-d69c41834ca2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2607403-71a8-48b7-ade6-d0982e01ef8a]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9bead9-f890-4df7-8758-a32e13c9b4a8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a1b66f-79e7-4482-9fb7-1170fd687908]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b1ae2-8587-4db5-8493-151c80410892]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193fd4e-35c2-4dc9-b0b0-313995b1e747]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260]
Oct 25 16:30:59 user nova-compute[74048]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044, portal: 172.16.0.220,3260] successful.
Oct 25 16:30:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f82c659-17b7-4d55-a2a5-ddc7172ba044 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966d541-7063-45dd-af7d-99df1e9427d5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] <== disconnect_volume: return (365ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:30:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Deleting instance files /opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3_del
Oct 25 16:30:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Deletion of /opt/stack/data/nova/instances/1bdfc844-9046-4f08-b276-2eee1d5fc5c3_del complete
Oct 25 16:30:59 user nova-compute[74048]: INFO nova.compute.manager [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 25 16:30:59 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:30:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:31:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:00 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:00 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Took 0.91 seconds to deallocate network for instance.
Oct 25 16:31:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] Acquiring lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] No waiting events found dispatching network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:00 user nova-compute[74048]: WARNING nova.compute.manager [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received unexpected event network-vif-plugged-ebbda323-9a84-4f24-9a1c-6c3359340b69 for instance with vm_state active and task_state deleting.
Oct 25 16:31:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-e3d7bb8b-1d5d-4eb2-a8c9-08fe646ebb2c req-57b2050d-f9ff-40a7-9548-f3e5fbf31774 service nova] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Received event network-vif-deleted-ebbda323-9a84-4f24-9a1c-6c3359340b69 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:01 user nova-compute[74048]: INFO nova.compute.manager [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Took 1.33 seconds to detach 1 volumes for instance.
Oct 25 16:31:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] [instance: 1bdfc844-9046-4f08-b276-2eee1d5fc5c3] Deleting volume: 0f82c659-17b7-4d55-a2a5-ddc7172ba044 {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.volume.cinder [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Update attachment failed for attachment f283a85b-6ad0-48c2-95fa-2790986a4c02. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d3601b4f-6d63-49e0-a8ea-be0342f6291d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d3601b4f-6d63-49e0-a8ea-be0342f6291d)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Failed to attach 2f62348a-0f28-4b67-b132-b6efbeb1188c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d3601b4f-6d63-49e0-a8ea-be0342f6291d)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522] Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     self._do_attach(context, instance, volume, volume_api,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     self._volume_attach(context, volume, connector, instance,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     connection_info = volume_api.attachment_update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     res = method(self, ctx, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     return method.func(obj, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     resp = self._update('/attachments/%s' % id, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     return self.request(url, method, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522]     raise exceptions.from_response(resp, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d3601b4f-6d63-49e0-a8ea-be0342f6291d)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 99762562-1e2b-4518-b61c-0acb35949522] 
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.940s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server [None req-1b93c249-ec33-4e91-9512-d57c9ff6f860 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d3601b4f-6d63-49e0-a8ea-be0342f6291d)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d3601b4f-6d63-49e0-a8ea-be0342f6291d)
Oct 25 16:31:02 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.volume.cinder [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Update attachment failed for attachment 94a5da90-3a6c-4fb2-a065-49c2f3dbab42. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self.driver.rebuild(**kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise NotImplementedError()
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] NotImplementedError
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] During handling of the above exception, another exception occurred:
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     driver_block_device.attach_block_devices(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     _log_and_attach(device)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     bdm.attach(*attach_args, **attach_kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._do_attach(context, instance, volume, volume_api,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._volume_attach(context, volume, connector, instance,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     connection_info = volume_api.attachment_update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     res = method(self, ctx, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     return method.func(obj, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     resp = self._update('/attachments/%s' % id, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     return self.request(url, method, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise exceptions.from_response(resp, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:31:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:02 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Deleted allocations for instance 1bdfc844-9046-4f08-b276-2eee1d5fc5c3
Oct 25 16:31:02 user nova-compute[74048]: DEBUG nova.compute.utils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169) {{(pid=74048) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self.driver.rebuild(**kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise NotImplementedError()
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] NotImplementedError
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] During handling of the above exception, another exception occurred:
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     driver_block_device.attach_block_devices(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     _log_and_attach(device)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     bdm.attach(*attach_args, **attach_kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._do_attach(context, instance, volume, volume_api,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._volume_attach(context, volume, connector, instance,
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     connection_info = volume_api.attachment_update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     res = method(self, ctx, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     with excutils.save_and_reraise_exception():
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self.force_reraise()
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise self.value
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     return method.func(obj, *args, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     resp = self._update('/attachments/%s' % id, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     return self.request(url, method, **kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise exceptions.from_response(resp, body)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] During handling of the above exception, another exception occurred:
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Traceback (most recent call last):
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     yield
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._do_rebuild_instance_with_claim(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._do_rebuild_instance(
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     self._rebuild_default_impl(**kwargs)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     new_block_device_info = attach_block_devices(context, instance, bdms)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7]     raise exception.InvalidBDM(str(ex))
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:02 user nova-compute[74048]: ERROR nova.compute.manager [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] 
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0e531de0-185f-40db-b935-455eac6f42b1 tempest-ServerActionsV293TestJSON-599396862 tempest-ServerActionsV293TestJSON-599396862-project-member] Lock "1bdfc844-9046-4f08-b276-2eee1d5fc5c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.641s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:03 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:31:03 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:31:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:03 user nova-compute[74048]: INFO nova.compute.manager [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server [None req-9160c778-27eb-494f-bb5c-2936e1cdd195 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4131, in _do_rebuild_instance
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server NotImplementedError
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e3d26a29-9dbb-4745-874f-a0a7b05db169)
Oct 25 16:31:03 user nova-compute[74048]: ERROR oslo_messaging.rpc.server 
Oct 25 16:31:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:19 user nova-compute[74048]: INFO nova.compute.manager [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Terminating instance
Oct 25 16:31:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-7ea6e2dc-1528-4f0f-ad2b-1cdaff48a010 req-bb6b52bd-9d1f-4a96-801f-7f3b7651a81b service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-vif-unplugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7ea6e2dc-1528-4f0f-ad2b-1cdaff48a010 req-bb6b52bd-9d1f-4a96-801f-7f3b7651a81b service nova] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7ea6e2dc-1528-4f0f-ad2b-1cdaff48a010 req-bb6b52bd-9d1f-4a96-801f-7f3b7651a81b service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7ea6e2dc-1528-4f0f-ad2b-1cdaff48a010 req-bb6b52bd-9d1f-4a96-801f-7f3b7651a81b service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-7ea6e2dc-1528-4f0f-ad2b-1cdaff48a010 req-bb6b52bd-9d1f-4a96-801f-7f3b7651a81b service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] No waiting events found dispatching network-vif-unplugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-7ea6e2dc-1528-4f0f-ad2b-1cdaff48a010 req-bb6b52bd-9d1f-4a96-801f-7f3b7651a81b service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-vif-unplugged-b7bee044-63d3-4bc2-b790-fd3ad318caec for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:31:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Instance destroyed successfully.
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'resources' on Instance uuid 405bc4c3-4446-45f1-aa47-439e298cdddd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1253644515',display_name='tempest-VolumesAdminNegativeTest-server-1253644515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1253644515',id=14,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:29:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4357e3da93604fd0a784aa60197f688a',ramdisk_id='',reservation_id='r-pqtg0qke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1275180142',owner_user_name='tempest-VolumesAdminNegativeTest-1275180142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:29:16Z,user_data=None,user_id='e764a620762b42b5a094def003269c4f',uuid=405bc4c3-4446-45f1-aa47-439e298cdddd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converting VIF {"id": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "address": "fa:16:3e:5d:71:09", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7bee044-63", "ovs_interfaceid": "b7bee044-63d3-4bc2-b790-fd3ad318caec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG os_vif [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7bee044-63, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04ddf19c-bc03-451e-b354-4948828d19bb) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:20 user nova-compute[74048]: INFO os_vif [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:09,bridge_name='br-int',has_traffic_filtering=True,id=b7bee044-63d3-4bc2-b790-fd3ad318caec,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7bee044-63')
Oct 25 16:31:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Deleting instance files /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd_del
Oct 25 16:31:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Deletion of /opt/stack/data/nova/instances/405bc4c3-4446-45f1-aa47-439e298cdddd_del complete
Oct 25 16:31:20 user nova-compute[74048]: INFO nova.compute.manager [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 16:31:20 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:31:20 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:21 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Took 0.63 seconds to deallocate network for instance.
Oct 25 16:31:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-f2c5a31a-2093-42ba-b624-d7d5f455b2fd req-c85e3deb-e5ee-41d8-aac4-c54add130cb7 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-vif-deleted-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:21 user nova-compute[74048]: INFO nova.compute.manager [req-f2c5a31a-2093-42ba-b624-d7d5f455b2fd req-c85e3deb-e5ee-41d8-aac4-c54add130cb7 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Neutron deleted interface b7bee044-63d3-4bc2-b790-fd3ad318caec; detaching it from the instance and deleting it from the info cache
Oct 25 16:31:21 user nova-compute[74048]: DEBUG nova.network.neutron [req-f2c5a31a-2093-42ba-b624-d7d5f455b2fd req-c85e3deb-e5ee-41d8-aac4-c54add130cb7 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-f2c5a31a-2093-42ba-b624-d7d5f455b2fd req-c85e3deb-e5ee-41d8-aac4-c54add130cb7 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Detach interface failed, port_id=b7bee044-63d3-4bc2-b790-fd3ad318caec, reason: Instance 405bc4c3-4446-45f1-aa47-439e298cdddd could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:31:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:21 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Deleted allocations for instance 405bc4c3-4446-45f1-aa47-439e298cdddd
Oct 25 16:31:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4bd490f0-d105-4ac8-817d-8fd3cd3e16dd tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.124s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f88db0ea-f104-40a0-87cd-258dbe50863d req-bd2d5f0d-0e9a-4d94-be63-c3a4d3e294c9 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received event network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f88db0ea-f104-40a0-87cd-258dbe50863d req-bd2d5f0d-0e9a-4d94-be63-c3a4d3e294c9 service nova] Acquiring lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f88db0ea-f104-40a0-87cd-258dbe50863d req-bd2d5f0d-0e9a-4d94-be63-c3a4d3e294c9 service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f88db0ea-f104-40a0-87cd-258dbe50863d req-bd2d5f0d-0e9a-4d94-be63-c3a4d3e294c9 service nova] Lock "405bc4c3-4446-45f1-aa47-439e298cdddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f88db0ea-f104-40a0-87cd-258dbe50863d req-bd2d5f0d-0e9a-4d94-be63-c3a4d3e294c9 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] No waiting events found dispatching network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:22 user nova-compute[74048]: WARNING nova.compute.manager [req-f88db0ea-f104-40a0-87cd-258dbe50863d req-bd2d5f0d-0e9a-4d94-be63-c3a4d3e294c9 service nova] [instance: 405bc4c3-4446-45f1-aa47-439e298cdddd] Received unexpected event network-vif-plugged-b7bee044-63d3-4bc2-b790-fd3ad318caec for instance with vm_state deleted and task_state None.
Oct 25 16:31:22 user nova-compute[74048]: INFO nova.compute.manager [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Unrescuing
Oct 25 16:31:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:22 user nova-compute[74048]: DEBUG nova.network.neutron [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG nova.network.neutron [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'flavor' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance destroyed successfully.
Oct 25 16:31:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:24 user nova-compute[74048]: WARNING nova.compute.manager [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:31:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:24 user nova-compute[74048]: WARNING nova.compute.manager [req-cd147cfa-4934-465f-80f9-b5b9bd2640e9 req-07e3cbb9-4860-482d-b45f-143a1d566358 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:31:24 user nova-compute[74048]: INFO nova.compute.claims [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Claim successful on node user
Oct 25 16:31:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:31:25 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:25 user nova-compute[74048]: INFO nova.virt.block_device [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Booting with volume 23176799-afe8-4224-af4f-32405d2889c4 at /dev/vda
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.policy [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9635f75f43d4f3ba9de24d0b9c0b5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c3b7a86214d47abe65768b55f57ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG os_brick.utils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc527559-7259-4b5c-87e2-d906c003f019]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ffb6e-2e9d-4261-a245-35bfc8649807]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae626c8-f3bd-471e-844d-9b9d5a330024]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b265839-14ff-4185-817f-3c65bde026a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:31:25 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:31:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[963243ee-d082-473e-aba0-d42da89c0698]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG os_brick.utils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:31:25 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating existing volume attachment record: fdb5fdbd-b95e-415e-883f-4beb0c5cd2eb {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:26 user nova-compute[74048]: WARNING nova.compute.manager [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:31:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:31:26 user nova-compute[74048]: WARNING nova.compute.manager [req-78d29bdd-16ac-4ed9-93f5-819c6d29dcc5 req-f1bca564-deb0-4181-a63b-74eeb68bdceb service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:31:26 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully created port: 69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:31:27 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully created port: 3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:31:28 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully created port: 7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:31:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-776673b9-d294-4fd9-8c3b-09f3be784bc4 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:31:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully created port: 78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:31:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully created port: cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: 69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-69f1479f-5ad1-46a0-8b8d-09a9b75c63af. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG nova.network.neutron [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG nova.network.neutron [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG nova.network.neutron [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b77eaebb-2184-4229-8458-b4742f1125a2 req-f95741f3-3956-4fbd-940e-6290b52bb211 service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: 8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-8a65faba-5a1b-452f-bc3e-e93c5eacf43d. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: 30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aada6c11-7726-416a-88b7-e18fd2cb972a req-85764bcd-e3ed-497a-be61-662e8398f68e service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-30f96d6a-afbf-4426-a047-1de09c23013e. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:35 user nova-compute[74048]: DEBUG nova.network.neutron [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:31:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: 3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:35 user nova-compute[74048]: DEBUG nova.network.neutron [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-994b89df-d119-4aaf-bc2b-450c868881d7 req-b151c30c-de5f-4c29-8c60-85dcb6fb10a8 service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:36 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: 7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-3d8f2e36-9f90-4fcc-86b1-40bbac58200d. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: 78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-7de34878-3091-4940-a4dd-8acede7c3b91. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9d7227fe-4150-4616-b0f6-545615e709be req-21f3dafc-bb8e-43c4-a7cb-57745097202b service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:38 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Successfully updated port: cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:31:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:38 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:31:38 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-78ac2898-af27-4f38-9ed2-f974a9f40354. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:31:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Skipping network cache update for instance because it is Building. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:42 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance network_info: |[{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updated VIF entry in instance network info cache for port 78ac2898-af27-4f38-9ed2-f974a9f40354. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-cd42c233-256a-4895-ada0-2957069b74a4. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG nova.network.neutron [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updated VIF entry in instance network info cache for port cd42c233-256a-4895-ada0-2957069b74a4. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1853222a-6212-4934-a5bf-18b9cf1f2df5 req-18040f21-b83b-437f-8087-a99a9f615b58 service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:47 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:31:47 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8016MB free_disk=25.65607452392578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 99762562-1e2b-4518-b61c-0acb35949522 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 29f3d942-10e2-406e-ad1c-edcf620669ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:31:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:31:47 user nova-compute[74048]: INFO nova.virt.block_device [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Booting with volume ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 at /dev/vdb
Oct 25 16:31:48 user nova-compute[74048]: DEBUG os_brick.utils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04dfb85-d7a2-48ed-8512-ce71de57b1a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbe8fd-2dbf-4cb7-9d24-c06932b8b1ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[913c2b9c-fc27-41e6-b39b-40d26478c95c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd73321-0ad8-48b2-bbc2-fce48adff58a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:31:48 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:31:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e390d46-1ed7-4776-88f7-a7ac4184259f]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG os_brick.utils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:31:48 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating existing volume attachment record: 58f714e0-e6f4-4256-9547-98de13d2269e {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:31:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:31:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:32:05 user nova-compute[74048]: INFO nova.compute.claims [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Claim successful on node user
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:32:06 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:32:06 user nova-compute[74048]: INFO nova.virt.block_device [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Booting with volume da74e58d-992d-40ad-9773-00eb07783c44 at /dev/vda
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.policy [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48ec0ba2f8824a2bacee58bf893a77d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f7ca267a294268b08d2452f427f8b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG os_brick.utils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9afb8de-f157-4d42-a7b6-2a1277801d8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d0ea4-9b96-4061-a8a7-30d451b90730]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c5ef3e-17ce-495f-883e-4f2590f6de17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb772d76-f48d-40b1-a99c-7ad70e7d973a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:32:06 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:32:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc671f5b-db67-40b8-a0d2-560a4e798da2]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG os_brick.utils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:06 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating existing volume attachment record: 59ff7700-e880-4e54-af27-6725258dc432 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:32:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Successfully created port: c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:32:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:32:08 user nova-compute[74048]: INFO nova.compute.claims [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Claim successful on node user
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Successfully updated port: c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-changed-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing instance network info cache due to event network-changed-c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:32:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.policy [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8fb16c6fa0c4e3a8e8b05bd0222b4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc9602800254bc4bf71768c629c59cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:32:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Creating image(s)
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: INFO nova.virt.block_device [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Booting with volume fd99f035-d66b-40cc-bff2-301662a34bec at /dev/vdc
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG os_brick.utils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance network_info: |[{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.network.neutron [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing network info cache for port c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk 1073741824" returned: 0 in 0.059s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b0d68-cba7-47d1-bd86-daea7166dee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae439b1-6545-4ff1-9835-45a75c9e4242]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8421bc01-f91e-4aa0-abcf-16dc6f7af93d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb077115-f32a-4508-82f4-ccba9d0c5eec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:32:09 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3410f-ddc9-403f-b96c-34f52731ea20]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG os_brick.utils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating existing volume attachment record: 3d8e723e-5606-46af-a953-42fdda671133 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Cannot resize image /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Ensure instance console log exists: /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Successfully created port: 1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:32:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updated VIF entry in instance network info cache for port c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:32:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-04579644-6c8b-41b7-bf4d-61ec123a32eb req-e8ad1641-f767-4540-96cd-d40ca3ac3ba1 service nova] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Successfully updated port: 1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquired lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-changed-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Refreshing instance network info cache due to event network-changed-1226b11a-beef-408e-b4b4-bf13383c8cde. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] Acquiring lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Releasing lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance network_info: |[{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] Acquired lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Refreshing network info cache for port 1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Start _get_guest_xml network_info=[{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:32:11 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:11 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-93929825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-93929825',id=18,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvvFjuGaODPDW3M0J8/43pwh8ovPqWKy/dy6XY1+h7DMUpnq2te7GFJeDZmlimngWhcsv+bxmsRq1r2zKhBX75jBabs+k3r1xodY2EuyVOk5Qy22mOGLVhxGqu212ChZA==',key_name='tempest-keypair-513469368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-8ltesbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=30783ca1-6eb2-4c19-907c-f4e84ca696ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'pci_devices' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:32:11 user nova-compute[74048]:   <uuid>30783ca1-6eb2-4c19-907c-f4e84ca696ac</uuid>
Oct 25 16:32:11 user nova-compute[74048]:   <name>instance-00000012</name>
Oct 25 16:32:11 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:32:11 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:32:11 user nova-compute[74048]:   <metadata>
Oct 25 16:32:11 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:32:11 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:32:11 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-93929825</nova:name>
Oct 25 16:32:11 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:32:11</nova:creationTime>
Oct 25 16:32:11 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:32:11 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:32:11 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:32:11 user nova-compute[74048]:       <nova:owner>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:user uuid="b8fb16c6fa0c4e3a8e8b05bd0222b4ba">tempest-AttachVolumeShelveTestJSON-1185084699-project-member</nova:user>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:project uuid="5dc9602800254bc4bf71768c629c59cf">tempest-AttachVolumeShelveTestJSON-1185084699</nova:project>
Oct 25 16:32:11 user nova-compute[74048]:       </nova:owner>
Oct 25 16:32:11 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:32:11 user nova-compute[74048]:       <nova:ports>
Oct 25 16:32:11 user nova-compute[74048]:         <nova:port uuid="1226b11a-beef-408e-b4b4-bf13383c8cde">
Oct 25 16:32:11 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 16:32:11 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:11 user nova-compute[74048]:       </nova:ports>
Oct 25 16:32:11 user nova-compute[74048]:     </nova:instance>
Oct 25 16:32:11 user nova-compute[74048]:   </metadata>
Oct 25 16:32:11 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:32:11 user nova-compute[74048]:     <system>
Oct 25 16:32:11 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:32:11 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:32:11 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:32:11 user nova-compute[74048]:       <entry name="serial">30783ca1-6eb2-4c19-907c-f4e84ca696ac</entry>
Oct 25 16:32:11 user nova-compute[74048]:       <entry name="uuid">30783ca1-6eb2-4c19-907c-f4e84ca696ac</entry>
Oct 25 16:32:11 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:32:11 user nova-compute[74048]:     </system>
Oct 25 16:32:11 user nova-compute[74048]:   </sysinfo>
Oct 25 16:32:11 user nova-compute[74048]:   <os>
Oct 25 16:32:11 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:32:11 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:32:11 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:32:11 user nova-compute[74048]:   </os>
Oct 25 16:32:11 user nova-compute[74048]:   <features>
Oct 25 16:32:11 user nova-compute[74048]:     <acpi/>
Oct 25 16:32:11 user nova-compute[74048]:     <apic/>
Oct 25 16:32:11 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:32:11 user nova-compute[74048]:   </features>
Oct 25 16:32:11 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:32:11 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:32:11 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:32:11 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:32:11 user nova-compute[74048]:   </clock>
Oct 25 16:32:11 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:32:11 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:32:11 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:32:11 user nova-compute[74048]:   </cpu>
Oct 25 16:32:11 user nova-compute[74048]:   <devices>
Oct 25 16:32:11 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:32:11 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:32:11 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk"/>
Oct 25 16:32:11 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:32:11 user nova-compute[74048]:     </disk>
Oct 25 16:32:11 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:11 user nova-compute[74048]:       <mac address="fa:16:3e:d6:46:f8"/>
Oct 25 16:32:11 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:11 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:11 user nova-compute[74048]:       <target dev="tap1226b11a-be"/>
Oct 25 16:32:11 user nova-compute[74048]:     </interface>
Oct 25 16:32:11 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:32:11 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/console.log" append="off"/>
Oct 25 16:32:11 user nova-compute[74048]:     </serial>
Oct 25 16:32:11 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:32:11 user nova-compute[74048]:     <video>
Oct 25 16:32:11 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:11 user nova-compute[74048]:     </video>
Oct 25 16:32:11 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:32:11 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:32:11 user nova-compute[74048]:     </rng>
Oct 25 16:32:11 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:32:11 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:32:11 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:32:11 user nova-compute[74048]:     </memballoon>
Oct 25 16:32:11 user nova-compute[74048]:   </devices>
Oct 25 16:32:11 user nova-compute[74048]: </domain>
Oct 25 16:32:11 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-93929825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-93929825',id=18,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvvFjuGaODPDW3M0J8/43pwh8ovPqWKy/dy6XY1+h7DMUpnq2te7GFJeDZmlimngWhcsv+bxmsRq1r2zKhBX75jBabs+k3r1xodY2EuyVOk5Qy22mOGLVhxGqu212ChZA==',key_name='tempest-keypair-513469368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-8ltesbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=30783ca1-6eb2-4c19-907c-f4e84ca696ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG os_vif [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13938fcb-9f0c-5d90-a38d-3c8711d52540', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1226b11a-be, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1226b11a-be, col_values=(('qos', UUID('9fda295d-540a-4e72-ac5e-4c7b0eb095f4')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1226b11a-be, col_values=(('external_ids', {'iface-id': '1226b11a-beef-408e-b4b4-bf13383c8cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:46:f8', 'vm-uuid': '30783ca1-6eb2-4c19-907c-f4e84ca696ac'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:11 user nova-compute[74048]: INFO os_vif [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be')
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:32:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No VIF found with MAC fa:16:3e:d6:46:f8, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:32:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updated VIF entry in instance network info cache for port 1226b11a-beef-408e-b4b4-bf13383c8cde. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:32:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ea0e13ea-71a8-40ef-8e44-420c59692ed8 req-24e01977-6074-48c2-83a7-845079d57332 service nova] Releasing lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-439d4164-2ca3-47d4-aebc-f181d5f7e65f req-e91f6453-481b-4308-92b6-cdaccbe753db service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-439d4164-2ca3-47d4-aebc-f181d5f7e65f req-e91f6453-481b-4308-92b6-cdaccbe753db service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-439d4164-2ca3-47d4-aebc-f181d5f7e65f req-e91f6453-481b-4308-92b6-cdaccbe753db service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-439d4164-2ca3-47d4-aebc-f181d5f7e65f req-e91f6453-481b-4308-92b6-cdaccbe753db service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-439d4164-2ca3-47d4-aebc-f181d5f7e65f req-e91f6453-481b-4308-92b6-cdaccbe753db service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:13 user nova-compute[74048]: WARNING nova.compute.manager [req-439d4164-2ca3-47d4-aebc-f181d5f7e65f req-e91f6453-481b-4308-92b6-cdaccbe753db service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state building and task_state spawning.
Oct 25 16:32:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-5c505f38-25d2-450b-8712-96407c3a6339 req-b5909da9-f0b1-4f02-ae29-bd003c65bb01 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5c505f38-25d2-450b-8712-96407c3a6339 req-b5909da9-f0b1-4f02-ae29-bd003c65bb01 service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5c505f38-25d2-450b-8712-96407c3a6339 req-b5909da9-f0b1-4f02-ae29-bd003c65bb01 service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5c505f38-25d2-450b-8712-96407c3a6339 req-b5909da9-f0b1-4f02-ae29-bd003c65bb01 service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-5c505f38-25d2-450b-8712-96407c3a6339 req-b5909da9-f0b1-4f02-ae29-bd003c65bb01 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:15 user nova-compute[74048]: WARNING nova.compute.manager [req-5c505f38-25d2-450b-8712-96407c3a6339 req-b5909da9-f0b1-4f02-ae29-bd003c65bb01 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state building and task_state spawning.
Oct 25 16:32:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:32:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:32:15 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance spawned successfully.
Oct 25 16:32:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:16 user nova-compute[74048]: INFO nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Took 7.14 seconds to spawn the instance on the hypervisor.
Oct 25 16:32:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:32:16 user nova-compute[74048]: INFO nova.compute.manager [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Took 8.22 seconds to build instance.
Oct 25 16:32:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2f39fd9-2b70-4229-9228-3aa3505454d1 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.378s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:32:19 user nova-compute[74048]: INFO nova.compute.claims [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Claim successful on node user
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:32:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.policy [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a9cf7fdde74b5a9eb622bfe8aec460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79842d08a1c14aa7ac769c4bcd476226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:32:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Creating image(s)
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "/opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "/opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.244s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk 1073741824" returned: 0 in 0.070s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Successfully created port: 82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.289s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:32:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Successfully updated port: 82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquired lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-changed-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Refreshing instance network info cache due to event network-changed-82dbd447-aff0-4c3e-ac60-7395297d3844. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] Acquiring lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:32:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:22 user nova-compute[74048]: INFO nova.compute.manager [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Terminating instance
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updating instance_info_cache with network_info: [{"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Releasing lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Instance network_info: |[{"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] Acquired lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.neutron [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Refreshing network info cache for port 82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Start _get_guest_xml network_info=[{"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2093880244',display_name='tempest-TestServerVolumeAttachmentScenario-server-2093880244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2093880244',id=19,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLcMmg1dqm4xc9ZaANT8hMmFOQ7C5dTgWkFUVY9SxOXxDKm35jDYFK4/tFGqzP3MhVlTUr9e4BKbOzgH8IAPmmRH5dMq2uYafIJzUus9dTLHdM78uqxk/IZM4XNMvW3jA==',key_name='tempest-keypair-1407394885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79842d08a1c14aa7ac769c4bcd476226',ramdisk_id='',reservation_id='r-4pjo1ri7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2054789310',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2054789310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a9cf7fdde74b5a9eb622bfe8aec460',uuid=0ad0d06b-51a7-469a-a11d-2416c00b94f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Converting VIF {"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:32:22 user nova-compute[74048]:   <uuid>0ad0d06b-51a7-469a-a11d-2416c00b94f1</uuid>
Oct 25 16:32:22 user nova-compute[74048]:   <name>instance-00000013</name>
Oct 25 16:32:22 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:32:22 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:32:22 user nova-compute[74048]:   <metadata>
Oct 25 16:32:22 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:32:22 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:32:22 user nova-compute[74048]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2093880244</nova:name>
Oct 25 16:32:22 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:32:22</nova:creationTime>
Oct 25 16:32:22 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:32:22 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:32:22 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:32:22 user nova-compute[74048]:       <nova:owner>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:user uuid="b1a9cf7fdde74b5a9eb622bfe8aec460">tempest-TestServerVolumeAttachmentScenario-2054789310-project-member</nova:user>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:project uuid="79842d08a1c14aa7ac769c4bcd476226">tempest-TestServerVolumeAttachmentScenario-2054789310</nova:project>
Oct 25 16:32:22 user nova-compute[74048]:       </nova:owner>
Oct 25 16:32:22 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:32:22 user nova-compute[74048]:       <nova:ports>
Oct 25 16:32:22 user nova-compute[74048]:         <nova:port uuid="82dbd447-aff0-4c3e-ac60-7395297d3844">
Oct 25 16:32:22 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 16:32:22 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:22 user nova-compute[74048]:       </nova:ports>
Oct 25 16:32:22 user nova-compute[74048]:     </nova:instance>
Oct 25 16:32:22 user nova-compute[74048]:   </metadata>
Oct 25 16:32:22 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:32:22 user nova-compute[74048]:     <system>
Oct 25 16:32:22 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:32:22 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:32:22 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:32:22 user nova-compute[74048]:       <entry name="serial">0ad0d06b-51a7-469a-a11d-2416c00b94f1</entry>
Oct 25 16:32:22 user nova-compute[74048]:       <entry name="uuid">0ad0d06b-51a7-469a-a11d-2416c00b94f1</entry>
Oct 25 16:32:22 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:32:22 user nova-compute[74048]:     </system>
Oct 25 16:32:22 user nova-compute[74048]:   </sysinfo>
Oct 25 16:32:22 user nova-compute[74048]:   <os>
Oct 25 16:32:22 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:32:22 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:32:22 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:32:22 user nova-compute[74048]:   </os>
Oct 25 16:32:22 user nova-compute[74048]:   <features>
Oct 25 16:32:22 user nova-compute[74048]:     <acpi/>
Oct 25 16:32:22 user nova-compute[74048]:     <apic/>
Oct 25 16:32:22 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:32:22 user nova-compute[74048]:   </features>
Oct 25 16:32:22 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:32:22 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:32:22 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:32:22 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:32:22 user nova-compute[74048]:   </clock>
Oct 25 16:32:22 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:32:22 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:32:22 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:32:22 user nova-compute[74048]:   </cpu>
Oct 25 16:32:22 user nova-compute[74048]:   <devices>
Oct 25 16:32:22 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:32:22 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:32:22 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk"/>
Oct 25 16:32:22 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:32:22 user nova-compute[74048]:     </disk>
Oct 25 16:32:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:22 user nova-compute[74048]:       <mac address="fa:16:3e:be:18:42"/>
Oct 25 16:32:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:22 user nova-compute[74048]:       <target dev="tap82dbd447-af"/>
Oct 25 16:32:22 user nova-compute[74048]:     </interface>
Oct 25 16:32:22 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:32:22 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/console.log" append="off"/>
Oct 25 16:32:22 user nova-compute[74048]:     </serial>
Oct 25 16:32:22 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:32:22 user nova-compute[74048]:     <video>
Oct 25 16:32:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:22 user nova-compute[74048]:     </video>
Oct 25 16:32:22 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:32:22 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:32:22 user nova-compute[74048]:     </rng>
Oct 25 16:32:22 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:32:22 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:32:22 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:32:22 user nova-compute[74048]:     </memballoon>
Oct 25 16:32:22 user nova-compute[74048]:   </devices>
Oct 25 16:32:22 user nova-compute[74048]: </domain>
Oct 25 16:32:22 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2093880244',display_name='tempest-TestServerVolumeAttachmentScenario-server-2093880244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2093880244',id=19,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLcMmg1dqm4xc9ZaANT8hMmFOQ7C5dTgWkFUVY9SxOXxDKm35jDYFK4/tFGqzP3MhVlTUr9e4BKbOzgH8IAPmmRH5dMq2uYafIJzUus9dTLHdM78uqxk/IZM4XNMvW3jA==',key_name='tempest-keypair-1407394885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79842d08a1c14aa7ac769c4bcd476226',ramdisk_id='',reservation_id='r-4pjo1ri7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2054789310',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2054789310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a9cf7fdde74b5a9eb622bfe8aec460',uuid=0ad0d06b-51a7-469a-a11d-2416c00b94f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Converting VIF {"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG os_vif [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb8c838b-576d-50d2-b837-d14ebf419130', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82dbd447-af, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82dbd447-af, col_values=(('qos', UUID('bb664316-f101-4702-9814-e6682eac842c')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82dbd447-af, col_values=(('external_ids', {'iface-id': '82dbd447-aff0-4c3e-ac60-7395297d3844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:18:42', 'vm-uuid': '0ad0d06b-51a7-469a-a11d-2416c00b94f1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: INFO os_vif [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af')
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-changed-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Refreshing instance network info cache due to event network-changed-6f95b356-29b3-4197-b96c-4d43b769bef8. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] Acquiring lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] Acquired lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.network.neutron [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Refreshing network info cache for port 6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No VIF found with MAC fa:16:3e:be:18:42, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-vif-unplugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] No waiting events found dispatching network-vif-unplugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-vif-unplugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] Acquiring lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] No waiting events found dispatching network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:23 user nova-compute[74048]: WARNING nova.compute.manager [req-87d296c7-c1f7-4567-99b7-f1219986046d req-2e74fca6-852f-4e4d-95c3-8315aa1d4a47 service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received unexpected event network-vif-plugged-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 for instance with vm_state active and task_state deleting.
Oct 25 16:32:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Instance destroyed successfully.
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lazy-loading 'resources' on Instance uuid bb58c025-8dec-4804-9b3e-f42a68e8b5ae {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-398279326',display_name='tempest-VolumesAdminNegativeTest-server-398279326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-398279326',id=6,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtuJSDWOyFU/2HLX01agPN0JLCT0/dV7aLvi9/DKmLTaG8Gi/S/7CvJVXZJD4+wtq1Q9vlQrzysXpE4IRiwWaasPnhdSJGlZD9Gctu5WErJaFQyPgDxxGEvxI4w1elmxg==',key_name='tempest-keypair-1151355184',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4357e3da93604fd0a784aa60197f688a',ramdisk_id='',reservation_id='r-ypymlkhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1275180142',owner_user_name='tempest-VolumesAdminNegativeTest-1275180142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:25:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e764a620762b42b5a094def003269c4f',uuid=bb58c025-8dec-4804-9b3e-f42a68e8b5ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converting VIF {"id": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "address": "fa:16:3e:05:33:ff", "network": {"id": "78fc5183-7f08-42df-914e-b13b023ac998", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-556876800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4357e3da93604fd0a784aa60197f688a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b11a8e3-fd", "ovs_interfaceid": "9b11a8e3-fd0d-48a8-b258-e6b7db930f11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG os_vif [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b11a8e3-fd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44ebce6c-d5a6-4726-a377-b85565bcf4b1) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:23 user nova-compute[74048]: INFO os_vif [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:33:ff,bridge_name='br-int',has_traffic_filtering=True,id=9b11a8e3-fd0d-48a8-b258-e6b7db930f11,network=Network(78fc5183-7f08-42df-914e-b13b023ac998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b11a8e3-fd')
Oct 25 16:32:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Deleting instance files /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae_del
Oct 25 16:32:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Deletion of /opt/stack/data/nova/instances/bb58c025-8dec-4804-9b3e-f42a68e8b5ae_del complete
Oct 25 16:32:24 user nova-compute[74048]: INFO nova.compute.manager [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Took 1.97 seconds to destroy the instance on the hypervisor.
Oct 25 16:32:24 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG nova.network.neutron [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updated VIF entry in instance network info cache for port 6f95b356-29b3-4197-b96c-4d43b769bef8. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG nova.network.neutron [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updating instance_info_cache with network_info: [{"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG nova.network.neutron [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updated VIF entry in instance network info cache for port 82dbd447-aff0-4c3e-ac60-7395297d3844. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG nova.network.neutron [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updating instance_info_cache with network_info: [{"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f24cebd9-c593-4078-b7b3-142a74b8e653 req-1c2b8c59-e8b7-4469-810a-41dff0677a22 service nova] Releasing lock "refresh_cache-a2a7443a-c48d-45f0-a7d3-829931f50ce6" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ec43c320-a98b-4d4e-9a04-8433ea88057c req-77ad7ab4-b19d-4f5c-a7bc-7d91d400446d service nova] Releasing lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] No waiting events found dispatching network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:26 user nova-compute[74048]: WARNING nova.compute.manager [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received unexpected event network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 for instance with vm_state building and task_state spawning.
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] No waiting events found dispatching network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:26 user nova-compute[74048]: WARNING nova.compute.manager [req-ff3a9c10-5271-4565-8047-b4a2c5522547 req-589cdb52-278b-4492-852d-80187732e94e service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received unexpected event network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 for instance with vm_state building and task_state spawning.
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:26 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Took 2.40 seconds to deallocate network for instance.
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-4776843d-3b98-42e5-b75e-7154ee62ac12 req-cdfc8c99-7482-432c-9970-fa9d47ed1a2f service nova] [instance: bb58c025-8dec-4804-9b3e-f42a68e8b5ae] Received event network-vif-deleted-9b11a8e3-fd0d-48a8-b258-e6b7db930f11 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:32:26 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:27 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Deleted allocations for instance bb58c025-8dec-4804-9b3e-f42a68e8b5ae
Oct 25 16:32:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-afea354d-2242-499b-8fbd-254e33e625ff tempest-VolumesAdminNegativeTest-1275180142 tempest-VolumesAdminNegativeTest-1275180142-project-member] Lock "bb58c025-8dec-4804-9b3e-f42a68e8b5ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.255s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:32:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Instance spawned successfully.
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:27 user nova-compute[74048]: INFO nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Took 7.70 seconds to spawn the instance on the hypervisor.
Oct 25 16:32:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:32:27 user nova-compute[74048]: INFO nova.compute.manager [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Took 8.76 seconds to build instance.
Oct 25 16:32:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d99dea1a-113c-4763-8d91-e07190a107e6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.907s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:32:30 user nova-compute[74048]: INFO nova.compute.claims [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Claim successful on node user
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:32:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Creating image(s)
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Ensure instance console log exists: /opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Start _get_guest_xml network_info=[{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '59ff7700-e880-4e54-af27-6725258dc432', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95c95f8e-996a-4ce3-a32d-b1fe86311740', 'attached_at': '', 'detached_at': '', 'volume_id': 'da74e58d-992d-40ad-9773-00eb07783c44', 'serial': 'da74e58d-992d-40ad-9773-00eb07783c44'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:32:30 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:30 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:30 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:30 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:30 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b9c37-cf1b-47e3-b4e5-a4e6cdf0cfde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:32:30 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b46b23-d644-489b-952e-534120a6c829]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44] added
Oct 25 16:32:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c4f978-23f9-4adb-86a4-ad7c47465278]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347bfec-2b0f-4d64-9759-70985a58e6fc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgPBLTxN {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgPBLTxN" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca07f34-0e5f-48f3-bef4-fd7408bd6808]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgPBLTxN'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8db86e-5105-4347-89aa-253c8bb8e718]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cf1784-71d3-4a6e-a1f6-9a62acc4b221]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:32:30 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:32:30 user nova-compute[74048]:  {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:30 user nova-compute[74048]: WARNING os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 16:32:30 user nova-compute[74048]: 
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14fd278-0db4-4abc-8315-0b028cea68e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]
Oct 25 16:32:30 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.
Oct 25 16:32:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d9158-af89-4f5a-89c8-b2f26826a203]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[186a22c5-90fa-4791-a257-5a3e4847ff07]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf826cd-f4ca-4f1e-95c3-49d7a9564579]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:32:31 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.policy [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a2170a4f3e541bea8147fbf3bc6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412dd65efab430eb361b71f048d3575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:32:31 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Creating image(s)
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "/opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.392s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23963613961336630', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613961336630', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.236s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-343536256',display_name='tempest-TestShelveInstance-server-343536256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-343536256',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1IrdCkUUsHiV4icGuo9klRC+AVh2R+t1h7+7dspODqRK7xS07YszymAEkMfWrLm/UKAwlnB8NXR9szHIk+yQLsI/8Et7KHEOjfK/t9THvLoo2mbxwRyL2LE80LH/RaSA==',key_name='tempest-TestShelveInstance-2011198275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00f7ca267a294268b08d2452f427f8b2',ramdisk_id='',reservation_id='r-bcsns6bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-686947210',owner_user_name='tempest-TestShelveInstance-686947210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:07Z,user_data=None,user_id='48ec0ba2f8824a2bacee58bf893a77d0',uuid=95c95f8e-996a-4ce3-a32d-b1fe86311740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converting VIF {"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'pci_devices' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk 1073741824" returned: 0 in 0.088s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Successfully created port: 239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:32:32 user nova-compute[74048]:   <uuid>95c95f8e-996a-4ce3-a32d-b1fe86311740</uuid>
Oct 25 16:32:32 user nova-compute[74048]:   <name>instance-00000011</name>
Oct 25 16:32:32 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:32:32 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:32:32 user nova-compute[74048]:   <metadata>
Oct 25 16:32:32 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:32:32 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:32:32 user nova-compute[74048]:       <nova:name>tempest-TestShelveInstance-server-343536256</nova:name>
Oct 25 16:32:32 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:32:30</nova:creationTime>
Oct 25 16:32:32 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:32:32 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:32:32 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:32:32 user nova-compute[74048]:       <nova:owner>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:user uuid="48ec0ba2f8824a2bacee58bf893a77d0">tempest-TestShelveInstance-686947210-project-member</nova:user>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:project uuid="00f7ca267a294268b08d2452f427f8b2">tempest-TestShelveInstance-686947210</nova:project>
Oct 25 16:32:32 user nova-compute[74048]:       </nova:owner>
Oct 25 16:32:32 user nova-compute[74048]:       <nova:ports>
Oct 25 16:32:32 user nova-compute[74048]:         <nova:port uuid="c39060db-5027-4548-993a-9975c447cfb7">
Oct 25 16:32:32 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 16:32:32 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:32 user nova-compute[74048]:       </nova:ports>
Oct 25 16:32:32 user nova-compute[74048]:     </nova:instance>
Oct 25 16:32:32 user nova-compute[74048]:   </metadata>
Oct 25 16:32:32 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:32:32 user nova-compute[74048]:     <system>
Oct 25 16:32:32 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:32:32 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:32:32 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:32:32 user nova-compute[74048]:       <entry name="serial">95c95f8e-996a-4ce3-a32d-b1fe86311740</entry>
Oct 25 16:32:32 user nova-compute[74048]:       <entry name="uuid">95c95f8e-996a-4ce3-a32d-b1fe86311740</entry>
Oct 25 16:32:32 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:32:32 user nova-compute[74048]:     </system>
Oct 25 16:32:32 user nova-compute[74048]:   </sysinfo>
Oct 25 16:32:32 user nova-compute[74048]:   <os>
Oct 25 16:32:32 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:32:32 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:32:32 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:32:32 user nova-compute[74048]:   </os>
Oct 25 16:32:32 user nova-compute[74048]:   <features>
Oct 25 16:32:32 user nova-compute[74048]:     <acpi/>
Oct 25 16:32:32 user nova-compute[74048]:     <apic/>
Oct 25 16:32:32 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:32:32 user nova-compute[74048]:   </features>
Oct 25 16:32:32 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:32:32 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:32:32 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:32:32 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:32:32 user nova-compute[74048]:   </clock>
Oct 25 16:32:32 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:32:32 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:32:32 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:32:32 user nova-compute[74048]:   </cpu>
Oct 25 16:32:32 user nova-compute[74048]:   <devices>
Oct 25 16:32:32 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:32:32 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:32:32 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:32:32 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:32:32 user nova-compute[74048]:       <serial>da74e58d-992d-40ad-9773-00eb07783c44</serial>
Oct 25 16:32:32 user nova-compute[74048]:     </disk>
Oct 25 16:32:32 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:32 user nova-compute[74048]:       <mac address="fa:16:3e:bc:fb:95"/>
Oct 25 16:32:32 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:32 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:32 user nova-compute[74048]:       <target dev="tapc39060db-50"/>
Oct 25 16:32:32 user nova-compute[74048]:     </interface>
Oct 25 16:32:32 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:32:32 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740/console.log" append="off"/>
Oct 25 16:32:32 user nova-compute[74048]:     </serial>
Oct 25 16:32:32 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:32:32 user nova-compute[74048]:     <video>
Oct 25 16:32:32 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:32 user nova-compute[74048]:     </video>
Oct 25 16:32:32 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:32:32 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:32:32 user nova-compute[74048]:     </rng>
Oct 25 16:32:32 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:32:32 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:32:32 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:32:32 user nova-compute[74048]:     </memballoon>
Oct 25 16:32:32 user nova-compute[74048]:   </devices>
Oct 25 16:32:32 user nova-compute[74048]: </domain>
Oct 25 16:32:32 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-343536256',display_name='tempest-TestShelveInstance-server-343536256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-343536256',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1IrdCkUUsHiV4icGuo9klRC+AVh2R+t1h7+7dspODqRK7xS07YszymAEkMfWrLm/UKAwlnB8NXR9szHIk+yQLsI/8Et7KHEOjfK/t9THvLoo2mbxwRyL2LE80LH/RaSA==',key_name='tempest-TestShelveInstance-2011198275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00f7ca267a294268b08d2452f427f8b2',ramdisk_id='',reservation_id='r-bcsns6bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-686947210',owner_user_name='tempest-TestShelveInstance-686947210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:07Z,user_data=None,user_id='48ec0ba2f8824a2bacee58bf893a77d0',uuid=95c95f8e-996a-4ce3-a32d-b1fe86311740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converting VIF {"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_vif [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17d25f83-8336-58b4-b6c5-de8cefeb13cc', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc39060db-50, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc39060db-50, col_values=(('qos', UUID('aabe9e2d-742e-44e4-829e-a94844549a01')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc39060db-50, col_values=(('external_ids', {'iface-id': 'c39060db-5027-4548-993a-9975c447cfb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:fb:95', 'vm-uuid': '95c95f8e-996a-4ce3-a32d-b1fe86311740'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:32 user nova-compute[74048]: INFO os_vif [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50')
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] No VIF found with MAC fa:16:3e:bc:fb:95, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lazy-loading 'flavor' on Instance uuid a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.268s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Cannot resize image /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Ensure instance console log exists: /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:32 user nova-compute[74048]: INFO nova.compute.manager [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Attaching volume decd8419-20b2-4c2d-b31b-50b8084214bc to /dev/vdb
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_brick.utils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f946525-52b6-4eda-b9ca-cf2f82017bef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f7ed8c-1ebf-4bad-b213-acc4d58149ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd53269-a236-4ba7-a571-7f423bc8891b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f63f2f-50ec-45f7-99a4-df934ce0c5d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:32:32 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:32:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f614e9-3b4f-4027-9ab6-997cb75ad93d]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG os_brick.utils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:32 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updating existing volume attachment record: 15ff2737-367c-419e-ae7a-9e8b8ae4fcb0 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Successfully updated port: 239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-changed-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Refreshing instance network info cache due to event network-changed-239dfdcc-6832-41bb-af41-3b6b56584e3a. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] Acquiring lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updating instance_info_cache with network_info: [{"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Instance network_info: |[{"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] Acquired lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Refreshing network info cache for port 239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Start _get_guest_xml network_info=[{"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:32:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469094947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469094947',id=20,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-s9j3wvt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:31Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d587e48c-2104-4f0b-a12c-7334a63d3d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'pci_devices' on Instance uuid d587e48c-2104-4f0b-a12c-7334a63d3d5f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:32:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Creating image(s)
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Ensure instance console log exists: /opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Start _get_guest_xml network_info=[{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'fdb5fdbd-b95e-415e-883f-4beb0c5cd2eb', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMzpJwbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29f3d942-10e2-406e-ad1c-edcf620669ba', 'attached_at': '', 'detached_at': '', 'volume_id': '23176799-afe8-4224-af4f-32405d2889c4', 'serial': '23176799-afe8-4224-af4f-32405d2889c4'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '58f714e0-e6f4-4256-9547-98de13d2269e', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjlrwVgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29f3d942-10e2-406e-ad1c-edcf620669ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1', 'serial': 'ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '3d8e723e-5606-46af-a953-42fdda671133', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFiHket', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29f3d942-10e2-406e-ad1c-edcf620669ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd99f035-d66b-40cc-bff2-301662a34bec', 'serial': 'fd99f035-d66b-40cc-bff2-301662a34bec'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:32:33 user nova-compute[74048]:   <uuid>d587e48c-2104-4f0b-a12c-7334a63d3d5f</uuid>
Oct 25 16:32:33 user nova-compute[74048]:   <name>instance-00000014</name>
Oct 25 16:32:33 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:32:33 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:32:33 user nova-compute[74048]:   <metadata>
Oct 25 16:32:33 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:32:33 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:32:33 user nova-compute[74048]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1469094947</nova:name>
Oct 25 16:32:33 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:32:33</nova:creationTime>
Oct 25 16:32:33 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:32:33 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:32:33 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:32:33 user nova-compute[74048]:       <nova:owner>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:user uuid="6a2170a4f3e541bea8147fbf3bc6b746">tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member</nova:user>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:project uuid="4412dd65efab430eb361b71f048d3575">tempest-ServerBootFromVolumeStableRescueTest-399579320</nova:project>
Oct 25 16:32:33 user nova-compute[74048]:       </nova:owner>
Oct 25 16:32:33 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:32:33 user nova-compute[74048]:       <nova:ports>
Oct 25 16:32:33 user nova-compute[74048]:         <nova:port uuid="239dfdcc-6832-41bb-af41-3b6b56584e3a">
Oct 25 16:32:33 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 16:32:33 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:33 user nova-compute[74048]:       </nova:ports>
Oct 25 16:32:33 user nova-compute[74048]:     </nova:instance>
Oct 25 16:32:33 user nova-compute[74048]:   </metadata>
Oct 25 16:32:33 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:32:33 user nova-compute[74048]:     <system>
Oct 25 16:32:33 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:32:33 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:32:33 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:32:33 user nova-compute[74048]:       <entry name="serial">d587e48c-2104-4f0b-a12c-7334a63d3d5f</entry>
Oct 25 16:32:33 user nova-compute[74048]:       <entry name="uuid">d587e48c-2104-4f0b-a12c-7334a63d3d5f</entry>
Oct 25 16:32:33 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:32:33 user nova-compute[74048]:     </system>
Oct 25 16:32:33 user nova-compute[74048]:   </sysinfo>
Oct 25 16:32:33 user nova-compute[74048]:   <os>
Oct 25 16:32:33 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:32:33 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:32:33 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:32:33 user nova-compute[74048]:   </os>
Oct 25 16:32:33 user nova-compute[74048]:   <features>
Oct 25 16:32:33 user nova-compute[74048]:     <acpi/>
Oct 25 16:32:33 user nova-compute[74048]:     <apic/>
Oct 25 16:32:33 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:32:33 user nova-compute[74048]:   </features>
Oct 25 16:32:33 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:32:33 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:32:33 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:32:33 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:32:33 user nova-compute[74048]:   </clock>
Oct 25 16:32:33 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:32:33 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:32:33 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:32:33 user nova-compute[74048]:   </cpu>
Oct 25 16:32:33 user nova-compute[74048]:   <devices>
Oct 25 16:32:33 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:32:33 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:32:33 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk"/>
Oct 25 16:32:33 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:32:33 user nova-compute[74048]:     </disk>
Oct 25 16:32:33 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:33 user nova-compute[74048]:       <mac address="fa:16:3e:9b:a8:7d"/>
Oct 25 16:32:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:33 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:33 user nova-compute[74048]:       <target dev="tap239dfdcc-68"/>
Oct 25 16:32:33 user nova-compute[74048]:     </interface>
Oct 25 16:32:33 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:32:33 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/console.log" append="off"/>
Oct 25 16:32:33 user nova-compute[74048]:     </serial>
Oct 25 16:32:33 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:32:33 user nova-compute[74048]:     <video>
Oct 25 16:32:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:33 user nova-compute[74048]:     </video>
Oct 25 16:32:33 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:32:33 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:32:33 user nova-compute[74048]:     </rng>
Oct 25 16:32:33 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:32:33 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:32:33 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:32:33 user nova-compute[74048]:     </memballoon>
Oct 25 16:32:33 user nova-compute[74048]:   </devices>
Oct 25 16:32:33 user nova-compute[74048]: </domain>
Oct 25 16:32:33 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469094947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469094947',id=20,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-s9j3wvt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:32:31Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d587e48c-2104-4f0b-a12c-7334a63d3d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_vif [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1fc1ee1-9609-5c2f-acee-c25c49ee268c', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap239dfdcc-68, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap239dfdcc-68, col_values=(('qos', UUID('163f194f-bbfc-4d63-9708-53bad46ec75b')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap239dfdcc-68, col_values=(('external_ids', {'iface-id': '239dfdcc-6832-41bb-af41-3b6b56584e3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:a8:7d', 'vm-uuid': 'd587e48c-2104-4f0b-a12c-7334a63d3d5f'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMzpJwbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:33 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: INFO os_vif [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68')
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b306565-2de7-4447-94a8-121d0fee1712]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:32:33 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b183968-ee58-4c44-98f7-421d38c239c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4] added
Oct 25 16:32:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[513740a6-e709-4e02-a802-88ed82af3634]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293ce63-955b-4fec-be88-216fcfbcef54]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No VIF found with MAC fa:16:3e:9b:a8:7d, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMzpJwbv {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMzpJwbv" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7edbf44-d42f-46bd-9d98-4f02defe6b28]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMzpJwbv'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31431db-b09d-470c-ab3c-3ceceb518228]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8def5b-a0cb-44cb-8a3b-b1bb45b1c50e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updated VIF entry in instance network info cache for port 239dfdcc-6832-41bb-af41-3b6b56584e3a. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updating instance_info_cache with network_info: [{"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-17d58c4b-77b8-4b8b-bd7f-244d089d085d req-14ad0294-89ae-414f-a7ad-7949f6c7d921 service nova] Releasing lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-6d9ecd1a-538f-4e2e-9a5b-01800d786bec req-f9683168-7981-48a3-9492-c3f18a41035b service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6d9ecd1a-538f-4e2e-9a5b-01800d786bec req-f9683168-7981-48a3-9492-c3f18a41035b service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6d9ecd1a-538f-4e2e-9a5b-01800d786bec req-f9683168-7981-48a3-9492-c3f18a41035b service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6d9ecd1a-538f-4e2e-9a5b-01800d786bec req-f9683168-7981-48a3-9492-c3f18a41035b service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-6d9ecd1a-538f-4e2e-9a5b-01800d786bec req-f9683168-7981-48a3-9492-c3f18a41035b service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:34 user nova-compute[74048]: WARNING nova.compute.manager [req-6d9ecd1a-538f-4e2e-9a5b-01800d786bec req-f9683168-7981-48a3-9492-c3f18a41035b service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state building and task_state spawning.
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.158s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70995e5-7563-4f89-b566-ea50269814b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260]
Oct 25 16:32:34 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260] successful.
Oct 25 16:32:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3a3f42-0486-4523-9b60-50cf51b4c06d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3a1e4-7a8e-4ce7-9365-5661edf628c7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:34 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:34 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df64aaca-ca4e-4421-8c7c-de66278e58f9]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMzpJwbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26665626531653661', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665626531653661', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjlrwVgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:35 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:35 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:35 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabbaaa6-273f-407a-b8d5-5a31bb3a2b3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:32:35 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[057b8878-2960-477f-afe3-854bbbaf71ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1] added
Oct 25 16:32:35 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade294b-9934-415c-b8c9-bcf2ef75b47f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f704184-742e-4a45-a050-3190d43bbad9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjlrwVgD {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjlrwVgD" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf399190-cf61-49c2-8821-e46fc6147235]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YjlrwVgD'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cf34df-22ff-49cc-aecc-4b297f7a17b0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9c7223-ce6c-4554-8acf-86c772a1ed15]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.138s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec022514-a1c3-4fcf-9168-5dc0634db849]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260]
Oct 25 16:32:35 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260] successful.
Oct 25 16:32:35 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b120d556-2d17-4caa-8d0a-81f9dc8f36ae]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5db255-1ca0-4ebc-a91a-304b03d22cbc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:32:35 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[796e60af-4908-4718-bd5e-06284e9e4c3b]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjlrwVgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-fd8446bb-7306-49af-9c14-21be9dbec798 req-7219a69c-5f1e-4bbe-ab2e-f323e3dab52c service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fd8446bb-7306-49af-9c14-21be9dbec798 req-7219a69c-5f1e-4bbe-ab2e-f323e3dab52c service nova] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fd8446bb-7306-49af-9c14-21be9dbec798 req-7219a69c-5f1e-4bbe-ab2e-f323e3dab52c service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fd8446bb-7306-49af-9c14-21be9dbec798 req-7219a69c-5f1e-4bbe-ab2e-f323e3dab52c service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-fd8446bb-7306-49af-9c14-21be9dbec798 req-7219a69c-5f1e-4bbe-ab2e-f323e3dab52c service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] No waiting events found dispatching network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:36 user nova-compute[74048]: WARNING nova.compute.manager [req-fd8446bb-7306-49af-9c14-21be9dbec798 req-7219a69c-5f1e-4bbe-ab2e-f323e3dab52c service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received unexpected event network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a for instance with vm_state building and task_state spawning.
Oct 25 16:32:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-edf37298-2288-4f68-8a2f-1b2d19748ec9 req-a8f75a16-0438-44f5-a915-fa7c9dc18cbd service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-edf37298-2288-4f68-8a2f-1b2d19748ec9 req-a8f75a16-0438-44f5-a915-fa7c9dc18cbd service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-edf37298-2288-4f68-8a2f-1b2d19748ec9 req-a8f75a16-0438-44f5-a915-fa7c9dc18cbd service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-edf37298-2288-4f68-8a2f-1b2d19748ec9 req-a8f75a16-0438-44f5-a915-fa7c9dc18cbd service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-edf37298-2288-4f68-8a2f-1b2d19748ec9 req-a8f75a16-0438-44f5-a915-fa7c9dc18cbd service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:36 user nova-compute[74048]: WARNING nova.compute.manager [req-edf37298-2288-4f68-8a2f-1b2d19748ec9 req-a8f75a16-0438-44f5-a915-fa7c9dc18cbd service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state building and task_state spawning.
Oct 25 16:32:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26635626538356437', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635626538356437', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFiHket', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:32:36 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:36 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:32:36 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed513cb-50ef-4485-a21f-21613cfe11b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:32:36 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4ceb68-d97c-44de-bf62-92b724fadfee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec] added
Oct 25 16:32:36 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f03ed8-5f3b-481f-ad33-395b654b6f50]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6373d839-57ce-45a5-808d-345ec9457b8b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFiHket {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbFiHket" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[229cc744-1979-4e5e-be8d-47bc7e510efd]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbFiHket'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4098fb4e-4d01-4720-b9b4-2d4813478be3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df854bcd-a743-4e94-95b3-6220a2969ae4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:36 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:36 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:32:36 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:36 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:36 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:32:36 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d49b13-c700-47ea-b93f-1109cd3b5552]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260]
Oct 25 16:32:37 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260] successful.
Oct 25 16:32:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[29522a32-7249-4821-8a61-8c4adfd79fbe]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f559f2-e7c5-4a81-be84-2db33ec2a796]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:37 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:37 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:32:37 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:32:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:32:37 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:32:37 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:32:37 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:32:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cfd085-d2bd-42ae-ab3f-5a41a1968c12]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFiHket', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:32:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance spawned successfully.
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:37 user nova-compute[74048]: INFO nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Took 7.36 seconds to spawn the instance on the hypervisor.
Oct 25 16:32:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:32:37 user nova-compute[74048]: INFO nova.compute.manager [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Took 32.04 seconds to build instance.
Oct 25 16:32:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f82c7034-073a-4061-bdd5-0846904e319c tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.155s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-0c3e6666-acc9-4453-b6e9-6644c7a9154d req-0d0ed6a4-af7f-481b-be74-6b466c5b2c89 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0c3e6666-acc9-4453-b6e9-6644c7a9154d req-0d0ed6a4-af7f-481b-be74-6b466c5b2c89 service nova] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0c3e6666-acc9-4453-b6e9-6644c7a9154d req-0d0ed6a4-af7f-481b-be74-6b466c5b2c89 service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0c3e6666-acc9-4453-b6e9-6644c7a9154d req-0d0ed6a4-af7f-481b-be74-6b466c5b2c89 service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-0c3e6666-acc9-4453-b6e9-6644c7a9154d req-0d0ed6a4-af7f-481b-be74-6b466c5b2c89 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] No waiting events found dispatching network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:38 user nova-compute[74048]: WARNING nova.compute.manager [req-0c3e6666-acc9-4453-b6e9-6644c7a9154d req-0d0ed6a4-af7f-481b-be74-6b466c5b2c89 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received unexpected event network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a for instance with vm_state building and task_state spawning.
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:32:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Instance spawned successfully.
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23330363734613665', 'path': '/dev/sde'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330363734613665', 'path': '/dev/sde'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lazy-loading 'pci_devices' on Instance uuid 29f3d942-10e2-406e-ad1c-edcf620669ba {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:32:38 user nova-compute[74048]: INFO nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Took 6.91 seconds to spawn the instance on the hypervisor.
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:32:38 user nova-compute[74048]:   <uuid>29f3d942-10e2-406e-ad1c-edcf620669ba</uuid>
Oct 25 16:32:38 user nova-compute[74048]:   <name>instance-00000010</name>
Oct 25 16:32:38 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:32:38 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:32:38 user nova-compute[74048]:   <metadata>
Oct 25 16:32:38 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:32:38 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:32:38 user nova-compute[74048]:       <nova:name>tempest-device-tagging-server-2140185194</nova:name>
Oct 25 16:32:38 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:32:33</nova:creationTime>
Oct 25 16:32:38 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:32:38 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:32:38 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:32:38 user nova-compute[74048]:       <nova:owner>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:user uuid="a9635f75f43d4f3ba9de24d0b9c0b5b0">tempest-TaggedBootDevicesTest-1300142545-project-member</nova:user>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:project uuid="ba3c3b7a86214d47abe65768b55f57ed">tempest-TaggedBootDevicesTest-1300142545</nova:project>
Oct 25 16:32:38 user nova-compute[74048]:       </nova:owner>
Oct 25 16:32:38 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:32:38 user nova-compute[74048]:       <nova:ports>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="69f1479f-5ad1-46a0-8b8d-09a9b75c63af">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="8a65faba-5a1b-452f-bc3e-e93c5eacf43d">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.43" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="30f96d6a-afbf-4426-a047-1de09c23013e">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="3d8f2e36-9f90-4fcc-86b1-40bbac58200d">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="7de34878-3091-4940-a4dd-8acede7c3b91">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.1.1.213" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="78ac2898-af27-4f38-9ed2-f974a9f40354">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:         <nova:port uuid="cd42c233-256a-4895-ada0-2957069b74a4">
Oct 25 16:32:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 16:32:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:32:38 user nova-compute[74048]:       </nova:ports>
Oct 25 16:32:38 user nova-compute[74048]:     </nova:instance>
Oct 25 16:32:38 user nova-compute[74048]:   </metadata>
Oct 25 16:32:38 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:32:38 user nova-compute[74048]:     <system>
Oct 25 16:32:38 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:32:38 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:32:38 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:32:38 user nova-compute[74048]:       <entry name="serial">29f3d942-10e2-406e-ad1c-edcf620669ba</entry>
Oct 25 16:32:38 user nova-compute[74048]:       <entry name="uuid">29f3d942-10e2-406e-ad1c-edcf620669ba</entry>
Oct 25 16:32:38 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:32:38 user nova-compute[74048]:     </system>
Oct 25 16:32:38 user nova-compute[74048]:   </sysinfo>
Oct 25 16:32:38 user nova-compute[74048]:   <os>
Oct 25 16:32:38 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:32:38 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:32:38 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:32:38 user nova-compute[74048]:   </os>
Oct 25 16:32:38 user nova-compute[74048]:   <features>
Oct 25 16:32:38 user nova-compute[74048]:     <acpi/>
Oct 25 16:32:38 user nova-compute[74048]:     <apic/>
Oct 25 16:32:38 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:32:38 user nova-compute[74048]:   </features>
Oct 25 16:32:38 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:32:38 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:32:38 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:32:38 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:32:38 user nova-compute[74048]:   </clock>
Oct 25 16:32:38 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:32:38 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:32:38 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:32:38 user nova-compute[74048]:   </cpu>
Oct 25 16:32:38 user nova-compute[74048]:   <devices>
Oct 25 16:32:38 user nova-compute[74048]:     <disk type="file" device="cdrom">
Oct 25 16:32:38 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 16:32:38 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba/disk.config"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="hda" bus="ide"/>
Oct 25 16:32:38 user nova-compute[74048]:     </disk>
Oct 25 16:32:38 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:32:38 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:32:38 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <serial>23176799-afe8-4224-af4f-32405d2889c4</serial>
Oct 25 16:32:38 user nova-compute[74048]:     </disk>
Oct 25 16:32:38 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:32:38 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:32:38 user nova-compute[74048]:       <source dev="/dev/sdd"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <serial>ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1</serial>
Oct 25 16:32:38 user nova-compute[74048]:     </disk>
Oct 25 16:32:38 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:32:38 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:32:38 user nova-compute[74048]:       <source dev="/dev/sde"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="vdc" bus="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <serial>fd99f035-d66b-40cc-bff2-301662a34bec</serial>
Oct 25 16:32:38 user nova-compute[74048]:     </disk>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:5e:7b:e7"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tap69f1479f-5a"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:40:f3:41"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tap8a65faba-5a"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:ca:67:ca"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tap30f96d6a-af"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:ed:66:7c"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tap3d8f2e36-9f"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:93:2b:c8"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tap7de34878-30"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:72:3e:7c"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tap78ac2898-af"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:32:38 user nova-compute[74048]:       <mac address="fa:16:3e:22:35:7d"/>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:32:38 user nova-compute[74048]:       <target dev="tapcd42c233-25"/>
Oct 25 16:32:38 user nova-compute[74048]:     </interface>
Oct 25 16:32:38 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:32:38 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba/console.log" append="off"/>
Oct 25 16:32:38 user nova-compute[74048]:     </serial>
Oct 25 16:32:38 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:32:38 user nova-compute[74048]:     <video>
Oct 25 16:32:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:32:38 user nova-compute[74048]:     </video>
Oct 25 16:32:38 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:32:38 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:32:38 user nova-compute[74048]:     </rng>
Oct 25 16:32:38 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:32:38 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:32:38 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:32:38 user nova-compute[74048]:     </memballoon>
Oct 25 16:32:38 user nova-compute[74048]:   </devices>
Oct 25 16:32:38 user nova-compute[74048]: </domain>
Oct 25 16:32:38 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b1fb3af-fc90-5f64-b835-4f1dd9357f1c', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69f1479f-5a, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69f1479f-5a, col_values=(('qos', UUID('278f3bab-5c23-4dc7-8c45-a4c017743687')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69f1479f-5a, col_values=(('external_ids', {'iface-id': '69f1479f-5ad1-46a0-8b8d-09a9b75c63af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:7b:e7', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a')
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '887eeced-eeb0-5071-8f51-506beb650cfa', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a65faba-5a, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a65faba-5a, col_values=(('qos', UUID('16e935fe-7d39-465d-bc3d-f76a6ca984df')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a65faba-5a, col_values=(('external_ids', {'iface-id': '8a65faba-5a1b-452f-bc3e-e93c5eacf43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:f3:41', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: INFO nova.compute.manager [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Took 7.98 seconds to build instance.
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a')
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54c204aa-56e9-53d8-886e-b4cbecc0b613', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-45ebdd71-f9d6-4628-8c38-a18af6a95b41 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.116s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30f96d6a-af, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30f96d6a-af, col_values=(('qos', UUID('e036a1d5-9951-4447-9afc-505de1644898')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30f96d6a-af, col_values=(('external_ids', {'iface-id': '30f96d6a-afbf-4426-a047-1de09c23013e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:67:ca', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af')
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48bb8220-25be-54ef-9d0d-ed3a77e41211', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d8f2e36-9f, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d8f2e36-9f, col_values=(('qos', UUID('f7908e8b-a41c-4158-a7aa-e99ca3baec4e')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d8f2e36-9f, col_values=(('external_ids', {'iface-id': '3d8f2e36-9f90-4fcc-86b1-40bbac58200d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:66:7c', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f')
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4c7d572-246b-5a62-81c5-0ebeee397174', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7de34878-30, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7de34878-30, col_values=(('qos', UUID('055dcc18-4c98-4842-8c59-88365d95ba1c')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7de34878-30, col_values=(('external_ids', {'iface-id': '7de34878-3091-4940-a4dd-8acede7c3b91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:2b:c8', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30')
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6c99e6b-fbce-5517-b625-84836f2912fd', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78ac2898-af, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78ac2898-af, col_values=(('qos', UUID('188c1302-272f-4f94-9c27-b900d33a32e4')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78ac2898-af, col_values=(('external_ids', {'iface-id': '78ac2898-af27-4f38-9ed2-f974a9f40354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:3e:7c', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af')
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f97a43aa-8d2a-5636-b506-63decf6aa2db', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd42c233-25, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd42c233-25, col_values=(('qos', UUID('9ecab8cf-0cda-4e6f-9abe-80f19dfd5ce1')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd42c233-25, col_values=(('external_ids', {'iface-id': 'cd42c233-256a-4895-ada0-2957069b74a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:35:7d', 'vm-uuid': '29f3d942-10e2-406e-ad1c-edcf620669ba'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:39 user nova-compute[74048]: INFO os_vif [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25')
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] No BDM found with device name hda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] No VIF found with MAC fa:16:3e:5e:7b:e7, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] No VIF found with MAC fa:16:3e:93:2b:c8, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:32:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Using config drive
Oct 25 16:32:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Creating config drive at /opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba/disk.config
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphtoyjli9 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphtoyjli9" returned: 0 in 0.064s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-161a2dd9-8410-4c40-b367-351f0573320a req-fa4cbcd1-e73f-4f83-82df-e35502315413 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-161a2dd9-8410-4c40-b367-351f0573320a req-fa4cbcd1-e73f-4f83-82df-e35502315413 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-161a2dd9-8410-4c40-b367-351f0573320a req-fa4cbcd1-e73f-4f83-82df-e35502315413 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-161a2dd9-8410-4c40-b367-351f0573320a req-fa4cbcd1-e73f-4f83-82df-e35502315413 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-161a2dd9-8410-4c40-b367-351f0573320a req-fa4cbcd1-e73f-4f83-82df-e35502315413 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:41 user nova-compute[74048]: WARNING nova.compute.manager [req-161a2dd9-8410-4c40-b367-351f0573320a req-fa4cbcd1-e73f-4f83-82df-e35502315413 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af for instance with vm_state building and task_state spawning.
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-7201d54f-9252-4ec8-ad42-dc53c3425c16 req-8e074d3c-38c4-478d-a550-86261adfe83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7201d54f-9252-4ec8-ad42-dc53c3425c16 req-8e074d3c-38c4-478d-a550-86261adfe83d service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7201d54f-9252-4ec8-ad42-dc53c3425c16 req-8e074d3c-38c4-478d-a550-86261adfe83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7201d54f-9252-4ec8-ad42-dc53c3425c16 req-8e074d3c-38c4-478d-a550-86261adfe83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-7201d54f-9252-4ec8-ad42-dc53c3425c16 req-8e074d3c-38c4-478d-a550-86261adfe83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:41 user nova-compute[74048]: WARNING nova.compute.manager [req-7201d54f-9252-4ec8-ad42-dc53c3425c16 req-8e074d3c-38c4-478d-a550-86261adfe83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d for instance with vm_state building and task_state spawning.
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-e9afa03c-6087-4235-833e-fc7ee8b121c1 req-9a99e737-d92b-4ac0-827c-a1bb47a19021 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e9afa03c-6087-4235-833e-fc7ee8b121c1 req-9a99e737-d92b-4ac0-827c-a1bb47a19021 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e9afa03c-6087-4235-833e-fc7ee8b121c1 req-9a99e737-d92b-4ac0-827c-a1bb47a19021 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e9afa03c-6087-4235-833e-fc7ee8b121c1 req-9a99e737-d92b-4ac0-827c-a1bb47a19021 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-e9afa03c-6087-4235-833e-fc7ee8b121c1 req-9a99e737-d92b-4ac0-827c-a1bb47a19021 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-e9afa03c-6087-4235-833e-fc7ee8b121c1 req-9a99e737-d92b-4ac0-827c-a1bb47a19021 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 for instance with vm_state building and task_state spawning.
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af for instance with vm_state building and task_state spawning.
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e for instance with vm_state building and task_state spawning.
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-2e388723-e660-43f0-9709-271cd9e023d0 req-a92d97b3-5193-49cc-aa60-2e51502cd6ad service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e for instance with vm_state building and task_state spawning.
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d for instance with vm_state building and task_state spawning.
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d for instance with vm_state building and task_state spawning.
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:43 user nova-compute[74048]: WARNING nova.compute.manager [req-55c58c44-fe45-49e5-8df8-dd3f1ba4c313 req-525612ee-3373-4058-8009-43f45800f83d service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d for instance with vm_state building and task_state spawning.
Oct 25 16:32:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:44 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-8eaa3b2e-6dea-43ca-9921-94739eaa8d70 req-7e9cb165-4643-4210-b0be-9e385352d9df service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8eaa3b2e-6dea-43ca-9921-94739eaa8d70 req-7e9cb165-4643-4210-b0be-9e385352d9df service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8eaa3b2e-6dea-43ca-9921-94739eaa8d70 req-7e9cb165-4643-4210-b0be-9e385352d9df service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8eaa3b2e-6dea-43ca-9921-94739eaa8d70 req-7e9cb165-4643-4210-b0be-9e385352d9df service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-8eaa3b2e-6dea-43ca-9921-94739eaa8d70 req-7e9cb165-4643-4210-b0be-9e385352d9df service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:45 user nova-compute[74048]: WARNING nova.compute.manager [req-8eaa3b2e-6dea-43ca-9921-94739eaa8d70 req-7e9cb165-4643-4210-b0be-9e385352d9df service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 for instance with vm_state building and task_state spawning.
Oct 25 16:32:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:45 user nova-compute[74048]: WARNING nova.compute.manager [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 for instance with vm_state building and task_state spawning.
Oct 25 16:32:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:45 user nova-compute[74048]: WARNING nova.compute.manager [req-654885e3-140f-4344-96f2-e62ee3b7e827 req-aa30c1c0-8bfb-4f11-bf84-8932a5678ebd service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 for instance with vm_state building and task_state spawning.
Oct 25 16:32:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:46 user nova-compute[74048]: WARNING nova.compute.manager [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 for instance with vm_state building and task_state spawning.
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:32:46 user nova-compute[74048]: WARNING nova.compute.manager [req-1a9e6f20-79dd-45c0-a8cd-f9e7ce364923 req-7895fd11-6622-47ba-a506-59a3a87a187f service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 for instance with vm_state building and task_state spawning.
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:32:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance spawned successfully.
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:47 user nova-compute[74048]: INFO nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Took 13.39 seconds to spawn the instance on the hypervisor.
Oct 25 16:32:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:32:47 user nova-compute[74048]: INFO nova.compute.manager [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Took 82.40 seconds to build instance.
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-34ce75eb-2198-443b-8bba-1663a0d4f6bf tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 82.516s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:32:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:32:50 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:50 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7580MB free_disk=25.58612823486328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 99762562-1e2b-4518-b61c-0acb35949522 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 29f3d942-10e2-406e-ad1c-edcf620669ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 95c95f8e-996a-4ce3-a32d-b1fe86311740 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:32:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:32:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:32:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrLKvnbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:33:08 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:33:08 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:33:08 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7780996c-54a7-4354-8e37-dc72c5e0edee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:33:08 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36b799-113d-4a84-a607-18ab54fc6bc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc] added
Oct 25 16:33:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[835747dc-6178-4f4a-9cbe-2a40fd1274e5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cf228e-5ad6-4137-94af-369ca630e643]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrLKvnbM {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrLKvnbM" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee84ee93-c262-46bd-bb14-d4a5fb851549]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrLKvnbM'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c0b0ec-6cb2-4f75-ad90-221394e263dc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab4c24-5fb9-4839-83f6-794931ae0556]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:33:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:33:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec77a97-9984-4bcd-8f64-c250479b0a21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260]
Oct 25 16:33:08 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260] successful.
Oct 25 16:33:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0f675-6300-4de7-a4c2-ab0c5ebfa38b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f3d824-3c46-4fc2-a74e-cfe22e3d2ad7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc (non-flash)
Oct 25 16:33:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:33:08 user nova-compute[74048]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc (non-flash)
Oct 25 16:33:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcca2fb-e8c7-446d-abef-497d35f10077]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrLKvnbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:33:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:33:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23433336265363533', 'path': '/dev/sdf'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:33:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433336265363533', 'path': '/dev/sdf'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:33:09 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lazy-loading 'flavor' on Instance uuid a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:33:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:33:09 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:33:09 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:33:09 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:33:09 user nova-compute[74048]:   <serial>decd8419-20b2-4c2d-b31b-50b8084214bc</serial>
Oct 25 16:33:09 user nova-compute[74048]: </disk>
Oct 25 16:33:09 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:33:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:33:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:33:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] No VIF found with MAC fa:16:3e:4d:d1:60, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:33:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e086a099-3e40-480a-837b-757e26951d12 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.859s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:12 user nova-compute[74048]: INFO nova.compute.manager [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Detaching volume decd8419-20b2-4c2d-b31b-50b8084214bc
Oct 25 16:33:12 user nova-compute[74048]: INFO nova.virt.block_device [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Attempting to driver detach volume decd8419-20b2-4c2d-b31b-50b8084214bc from mountpoint /dev/vdb
Oct 25 16:33:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Attempting to detach device vdb from instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:33:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:33:12 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:33:12 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:33:12 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:33:12 user nova-compute[74048]:   <serial>decd8419-20b2-4c2d-b31b-50b8084214bc</serial>
Oct 25 16:33:12 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:33:12 user nova-compute[74048]: </disk>
Oct 25 16:33:12 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:33:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Successfully detached device vdb from instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 from the persistent domain config.
Oct 25 16:33:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:33:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:33:12 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:33:12 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:33:12 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:33:12 user nova-compute[74048]:   <serial>decd8419-20b2-4c2d-b31b-50b8084214bc</serial>
Oct 25 16:33:12 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:33:12 user nova-compute[74048]: </disk>
Oct 25 16:33:12 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:33:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:33:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:33:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:33:22 user nova-compute[74048]: INFO nova.compute.claims [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Claim successful on node user
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:33:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.policy [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ff1b26939b49ba88fe0105bec65fc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '931f649d6b844bbdaec9f1b97ab1112c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:33:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Creating image(s)
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.234s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk 1073741824" returned: 0 in 0.072s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Successfully created port: eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Cannot resize image /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Ensure instance console log exists: /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Successfully updated port: eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing instance network info cache due to event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.neutron [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance network_info: |[{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.neutron [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Start _get_guest_xml network_info=[{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:33:25 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:33:25 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-673488562',display_name='tempest-ServerRescueNegativeTestJSON-server-673488562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-673488562',id=21,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmNeLNw9htCIEO231GPElA6ydc2Uc3wg0whqBcPQYXqnSe3ubg6fZPtmXkqaWAcNN+Xs134+oixSppb8lj9PqbxooDRz2hA85UXAM6fxBcGkqboSE8AbcT3vJE2dYMXA==',key_name='tempest-keypair-1695340235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-qtkf4aw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=c7c52922-5f40-4d8b-937d-9cec99edd27f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.objects.instance [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'pci_devices' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:33:25 user nova-compute[74048]:   <uuid>c7c52922-5f40-4d8b-937d-9cec99edd27f</uuid>
Oct 25 16:33:25 user nova-compute[74048]:   <name>instance-00000015</name>
Oct 25 16:33:25 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:33:25 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:33:25 user nova-compute[74048]:   <metadata>
Oct 25 16:33:25 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:33:25 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:33:25 user nova-compute[74048]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-673488562</nova:name>
Oct 25 16:33:25 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:33:25</nova:creationTime>
Oct 25 16:33:25 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:33:25 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:33:25 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:33:25 user nova-compute[74048]:       <nova:owner>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:user uuid="94ff1b26939b49ba88fe0105bec65fc2">tempest-ServerRescueNegativeTestJSON-1121503960-project-member</nova:user>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:project uuid="931f649d6b844bbdaec9f1b97ab1112c">tempest-ServerRescueNegativeTestJSON-1121503960</nova:project>
Oct 25 16:33:25 user nova-compute[74048]:       </nova:owner>
Oct 25 16:33:25 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:33:25 user nova-compute[74048]:       <nova:ports>
Oct 25 16:33:25 user nova-compute[74048]:         <nova:port uuid="eca5c7af-25bc-4905-8a8d-927cf755084f">
Oct 25 16:33:25 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:33:25 user nova-compute[74048]:         </nova:port>
Oct 25 16:33:25 user nova-compute[74048]:       </nova:ports>
Oct 25 16:33:25 user nova-compute[74048]:     </nova:instance>
Oct 25 16:33:25 user nova-compute[74048]:   </metadata>
Oct 25 16:33:25 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:33:25 user nova-compute[74048]:     <system>
Oct 25 16:33:25 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:33:25 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:33:25 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:33:25 user nova-compute[74048]:       <entry name="serial">c7c52922-5f40-4d8b-937d-9cec99edd27f</entry>
Oct 25 16:33:25 user nova-compute[74048]:       <entry name="uuid">c7c52922-5f40-4d8b-937d-9cec99edd27f</entry>
Oct 25 16:33:25 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:33:25 user nova-compute[74048]:     </system>
Oct 25 16:33:25 user nova-compute[74048]:   </sysinfo>
Oct 25 16:33:25 user nova-compute[74048]:   <os>
Oct 25 16:33:25 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:33:25 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:33:25 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:33:25 user nova-compute[74048]:   </os>
Oct 25 16:33:25 user nova-compute[74048]:   <features>
Oct 25 16:33:25 user nova-compute[74048]:     <acpi/>
Oct 25 16:33:25 user nova-compute[74048]:     <apic/>
Oct 25 16:33:25 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:33:25 user nova-compute[74048]:   </features>
Oct 25 16:33:25 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:33:25 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:33:25 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:33:25 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:33:25 user nova-compute[74048]:   </clock>
Oct 25 16:33:25 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:33:25 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:33:25 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:33:25 user nova-compute[74048]:   </cpu>
Oct 25 16:33:25 user nova-compute[74048]:   <devices>
Oct 25 16:33:25 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:33:25 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:33:25 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk"/>
Oct 25 16:33:25 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:33:25 user nova-compute[74048]:     </disk>
Oct 25 16:33:25 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:33:25 user nova-compute[74048]:       <mac address="fa:16:3e:32:60:1b"/>
Oct 25 16:33:25 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:33:25 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:33:25 user nova-compute[74048]:       <target dev="tapeca5c7af-25"/>
Oct 25 16:33:25 user nova-compute[74048]:     </interface>
Oct 25 16:33:25 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:33:25 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/console.log" append="off"/>
Oct 25 16:33:25 user nova-compute[74048]:     </serial>
Oct 25 16:33:25 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:33:25 user nova-compute[74048]:     <video>
Oct 25 16:33:25 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:33:25 user nova-compute[74048]:     </video>
Oct 25 16:33:25 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:33:25 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:33:25 user nova-compute[74048]:     </rng>
Oct 25 16:33:25 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:33:25 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:33:25 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:33:25 user nova-compute[74048]:     </memballoon>
Oct 25 16:33:25 user nova-compute[74048]:   </devices>
Oct 25 16:33:25 user nova-compute[74048]: </domain>
Oct 25 16:33:25 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-673488562',display_name='tempest-ServerRescueNegativeTestJSON-server-673488562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-673488562',id=21,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmNeLNw9htCIEO231GPElA6ydc2Uc3wg0whqBcPQYXqnSe3ubg6fZPtmXkqaWAcNN+Xs134+oixSppb8lj9PqbxooDRz2hA85UXAM6fxBcGkqboSE8AbcT3vJE2dYMXA==',key_name='tempest-keypair-1695340235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-qtkf4aw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:33:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=c7c52922-5f40-4d8b-937d-9cec99edd27f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG os_vif [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c011a7b3-6ebe-56b7-b720-3d7f01535b66', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:33:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeca5c7af-25, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeca5c7af-25, col_values=(('qos', UUID('e62fef19-05bb-46ab-8b10-378ac217ca3b')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeca5c7af-25, col_values=(('external_ids', {'iface-id': 'eca5c7af-25bc-4905-8a8d-927cf755084f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:60:1b', 'vm-uuid': 'c7c52922-5f40-4d8b-937d-9cec99edd27f'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:26 user nova-compute[74048]: INFO os_vif [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25')
Oct 25 16:33:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:32:60:1b, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG nova.network.neutron [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updated VIF entry in instance network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG nova.network.neutron [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1b291b90-51b4-4d76-8a6e-504b7564221e req-aac36120-c215-45b3-a367-15c63b534fe6 service nova] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-d26f5b43-91c8-458b-a134-4ce75abf0a7b req-3e624a59-3169-40ab-bf2b-02ae88b1dc39 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d26f5b43-91c8-458b-a134-4ce75abf0a7b req-3e624a59-3169-40ab-bf2b-02ae88b1dc39 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d26f5b43-91c8-458b-a134-4ce75abf0a7b req-3e624a59-3169-40ab-bf2b-02ae88b1dc39 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d26f5b43-91c8-458b-a134-4ce75abf0a7b req-3e624a59-3169-40ab-bf2b-02ae88b1dc39 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-d26f5b43-91c8-458b-a134-4ce75abf0a7b req-3e624a59-3169-40ab-bf2b-02ae88b1dc39 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:33:29 user nova-compute[74048]: WARNING nova.compute.manager [req-d26f5b43-91c8-458b-a134-4ce75abf0a7b req-3e624a59-3169-40ab-bf2b-02ae88b1dc39 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state building and task_state spawning.
Oct 25 16:33:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:33:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance spawned successfully.
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:29 user nova-compute[74048]: INFO nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Took 6.35 seconds to spawn the instance on the hypervisor.
Oct 25 16:33:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:33:29 user nova-compute[74048]: INFO nova.compute.manager [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Took 7.28 seconds to build instance.
Oct 25 16:33:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7bd147a9-9c90-47db-85e3-4ff50403398e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.402s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-e4092d2b-f5e7-441b-b970-15c514235235 req-f42b4b1c-3593-4eed-aa75-de5c5c347690 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e4092d2b-f5e7-441b-b970-15c514235235 req-f42b4b1c-3593-4eed-aa75-de5c5c347690 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e4092d2b-f5e7-441b-b970-15c514235235 req-f42b4b1c-3593-4eed-aa75-de5c5c347690 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e4092d2b-f5e7-441b-b970-15c514235235 req-f42b4b1c-3593-4eed-aa75-de5c5c347690 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-e4092d2b-f5e7-441b-b970-15c514235235 req-f42b4b1c-3593-4eed-aa75-de5c5c347690 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:33:31 user nova-compute[74048]: WARNING nova.compute.manager [req-e4092d2b-f5e7-441b-b970-15c514235235 req-f42b4b1c-3593-4eed-aa75-de5c5c347690 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state active and task_state None.
Oct 25 16:33:32 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 is timed out.
Oct 25 16:33:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Successfully detached device vdb from instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 from the live domain config.
Oct 25 16:33:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrLKvnbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:33:32 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a5ce5-5b28-4b2c-985b-99f5ee72b2ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:33:32 user nova-compute[74048]: No targets found.
Oct 25 16:33:32 user nova-compute[74048]: iSNS:
Oct 25 16:33:32 user nova-compute[74048]: No targets found.
Oct 25 16:33:32 user nova-compute[74048]: STATIC:
Oct 25 16:33:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4
Oct 25 16:33:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1
Oct 25 16:33:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec
Oct 25 16:33:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc
Oct 25 16:33:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44
Oct 25 16:33:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:32 user nova-compute[74048]: FIRMWARE:
Oct 25 16:33:32 user nova-compute[74048]: No targets found.
Oct 25 16:33:32 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:33:32 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:33:32 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9d4e8-962b-4621-bdca-65ba6b08e7f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a20980-7b4c-49d8-ba3b-93c8ea8f25e3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc (non-flash)
Oct 25 16:33:32 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:33:32 user nova-compute[74048]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc (non-flash)
Oct 25 16:33:32 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18404393f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc'): ({'sdf'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Removing single pathed devices sdf {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:33:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed921c-64cf-48a6-8f85-2fe6bf9c99f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562e6de-32b3-4ed4-86d9-b43783da2a49]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Flushing IO for device /dev/sdf {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e0f48-6c15-40c4-9c09-c2e398294ec4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c03158-8709-4a97-a4bd-30837c964dc7]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ff0fe-0ba6-4bcf-becb-6e9bc7998938]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb48d20-d558-421d-a42b-6f1f535767a7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260]
Oct 25 16:33:33 user nova-compute[74048]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc, portal: 172.16.0.220,3260] successful.
Oct 25 16:33:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decd8419-20b2-4c2d-b31b-50b8084214bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e1ab62-9712-4bed-81d3-3ed21b87103a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] <== disconnect_volume: return (403ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:33:33 user nova-compute[74048]: INFO nova.compute.claims [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Claim successful on node user
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.network.neutron [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.objects.instance [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lazy-loading 'flavor' on Instance uuid a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:33:34 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12997fb9-e71a-41a9-92cf-c6577cf353f7 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.994s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.policy [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce6cca46ca1142e7b9755e80e76e853e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a44a4b9a261c4765901e177879113b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:33:34 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Creating image(s)
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk 1073741824" returned: 0 in 0.063s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Successfully created port: a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.236s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Cannot resize image /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Ensure instance console log exists: /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Successfully updated port: a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing instance network info cache due to event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.neutron [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance network_info: |[{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Start _get_guest_xml network_info=[{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:33:36 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:33:36 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-385805206',display_name='tempest-ServerStableDeviceRescueTest-server-385805206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-385805206',id=22,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsc1tXpqwtR2rS24hEi1/EO3kDqyp7qx2H7g98JNtlfkpRqSHHwild/rwLwUnnYeQsqbDKMA/Li2sJWTYVskmur2vnztyca6Jo0k0m6IPCIdx7QjAhjvrW4va6gh3s15A==',key_name='tempest-keypair-1484637459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a44a4b9a261c4765901e177879113b75',ramdisk_id='',reservation_id='r-wskb0uet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-16526362',owner_user_name='tempest-ServerStableDeviceRescueTest-16526362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cca46ca1142e7b9755e80e76e853e',uuid=ed271afb-bdb0-418f-b759-ad86ea0a79a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converting VIF {"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.objects.instance [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'pci_devices' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:33:36 user nova-compute[74048]:   <uuid>ed271afb-bdb0-418f-b759-ad86ea0a79a0</uuid>
Oct 25 16:33:36 user nova-compute[74048]:   <name>instance-00000016</name>
Oct 25 16:33:36 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:33:36 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:33:36 user nova-compute[74048]:   <metadata>
Oct 25 16:33:36 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:33:36 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:33:36 user nova-compute[74048]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-385805206</nova:name>
Oct 25 16:33:36 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:33:36</nova:creationTime>
Oct 25 16:33:36 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:33:36 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:33:36 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:33:36 user nova-compute[74048]:       <nova:owner>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:user uuid="ce6cca46ca1142e7b9755e80e76e853e">tempest-ServerStableDeviceRescueTest-16526362-project-member</nova:user>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:project uuid="a44a4b9a261c4765901e177879113b75">tempest-ServerStableDeviceRescueTest-16526362</nova:project>
Oct 25 16:33:36 user nova-compute[74048]:       </nova:owner>
Oct 25 16:33:36 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:33:36 user nova-compute[74048]:       <nova:ports>
Oct 25 16:33:36 user nova-compute[74048]:         <nova:port uuid="a87afd20-35e1-40f8-81e2-ad3964a04feb">
Oct 25 16:33:36 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:33:36 user nova-compute[74048]:         </nova:port>
Oct 25 16:33:36 user nova-compute[74048]:       </nova:ports>
Oct 25 16:33:36 user nova-compute[74048]:     </nova:instance>
Oct 25 16:33:36 user nova-compute[74048]:   </metadata>
Oct 25 16:33:36 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:33:36 user nova-compute[74048]:     <system>
Oct 25 16:33:36 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:33:36 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:33:36 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:33:36 user nova-compute[74048]:       <entry name="serial">ed271afb-bdb0-418f-b759-ad86ea0a79a0</entry>
Oct 25 16:33:36 user nova-compute[74048]:       <entry name="uuid">ed271afb-bdb0-418f-b759-ad86ea0a79a0</entry>
Oct 25 16:33:36 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:33:36 user nova-compute[74048]:     </system>
Oct 25 16:33:36 user nova-compute[74048]:   </sysinfo>
Oct 25 16:33:36 user nova-compute[74048]:   <os>
Oct 25 16:33:36 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:33:36 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:33:36 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:33:36 user nova-compute[74048]:   </os>
Oct 25 16:33:36 user nova-compute[74048]:   <features>
Oct 25 16:33:36 user nova-compute[74048]:     <acpi/>
Oct 25 16:33:36 user nova-compute[74048]:     <apic/>
Oct 25 16:33:36 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:33:36 user nova-compute[74048]:   </features>
Oct 25 16:33:36 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:33:36 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:33:36 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:33:36 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:33:36 user nova-compute[74048]:   </clock>
Oct 25 16:33:36 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:33:36 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:33:36 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:33:36 user nova-compute[74048]:   </cpu>
Oct 25 16:33:36 user nova-compute[74048]:   <devices>
Oct 25 16:33:36 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:33:36 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:33:36 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk"/>
Oct 25 16:33:36 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:33:36 user nova-compute[74048]:     </disk>
Oct 25 16:33:36 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:33:36 user nova-compute[74048]:       <mac address="fa:16:3e:42:51:6d"/>
Oct 25 16:33:36 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:33:36 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:33:36 user nova-compute[74048]:       <target dev="tapa87afd20-35"/>
Oct 25 16:33:36 user nova-compute[74048]:     </interface>
Oct 25 16:33:36 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:33:36 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/console.log" append="off"/>
Oct 25 16:33:36 user nova-compute[74048]:     </serial>
Oct 25 16:33:36 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:33:36 user nova-compute[74048]:     <video>
Oct 25 16:33:36 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:33:36 user nova-compute[74048]:     </video>
Oct 25 16:33:36 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:33:36 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:33:36 user nova-compute[74048]:     </rng>
Oct 25 16:33:36 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:33:36 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:33:36 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:33:36 user nova-compute[74048]:     </memballoon>
Oct 25 16:33:36 user nova-compute[74048]:   </devices>
Oct 25 16:33:36 user nova-compute[74048]: </domain>
Oct 25 16:33:36 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-385805206',display_name='tempest-ServerStableDeviceRescueTest-server-385805206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-385805206',id=22,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsc1tXpqwtR2rS24hEi1/EO3kDqyp7qx2H7g98JNtlfkpRqSHHwild/rwLwUnnYeQsqbDKMA/Li2sJWTYVskmur2vnztyca6Jo0k0m6IPCIdx7QjAhjvrW4va6gh3s15A==',key_name='tempest-keypair-1484637459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a44a4b9a261c4765901e177879113b75',ramdisk_id='',reservation_id='r-wskb0uet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-16526362',owner_user_name='tempest-ServerStableDeviceRescueTest-16526362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cca46ca1142e7b9755e80e76e853e',uuid=ed271afb-bdb0-418f-b759-ad86ea0a79a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converting VIF {"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG os_vif [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4d4f126-2b35-509d-9495-2dd0e770064d', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa87afd20-35, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa87afd20-35, col_values=(('qos', UUID('3299a1f1-10bc-43bc-a876-de3e63147d26')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa87afd20-35, col_values=(('external_ids', {'iface-id': 'a87afd20-35e1-40f8-81e2-ad3964a04feb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:51:6d', 'vm-uuid': 'ed271afb-bdb0-418f-b759-ad86ea0a79a0'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:36 user nova-compute[74048]: INFO os_vif [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35')
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No VIF found with MAC fa:16:3e:42:51:6d, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updated VIF entry in instance network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3aabbeb1-e826-4c61-a058-8bf469a8ebc2 req-960670f7-e516-4261-a403-38c6f43a4d34 service nova] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-6c8a833d-bf6f-47f6-8c0a-c0252ac013f0 req-a182e03d-800a-4f94-bd60-cb58dc652dde service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6c8a833d-bf6f-47f6-8c0a-c0252ac013f0 req-a182e03d-800a-4f94-bd60-cb58dc652dde service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6c8a833d-bf6f-47f6-8c0a-c0252ac013f0 req-a182e03d-800a-4f94-bd60-cb58dc652dde service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6c8a833d-bf6f-47f6-8c0a-c0252ac013f0 req-a182e03d-800a-4f94-bd60-cb58dc652dde service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-6c8a833d-bf6f-47f6-8c0a-c0252ac013f0 req-a182e03d-800a-4f94-bd60-cb58dc652dde service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:33:38 user nova-compute[74048]: WARNING nova.compute.manager [req-6c8a833d-bf6f-47f6-8c0a-c0252ac013f0 req-a182e03d-800a-4f94-bd60-cb58dc652dde service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state building and task_state spawning.
Oct 25 16:33:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-2b84f27c-37c3-4f7e-97f9-106b2f18a3a6 req-f061b4f5-d60b-47ac-9623-9aaba4c24f08 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2b84f27c-37c3-4f7e-97f9-106b2f18a3a6 req-f061b4f5-d60b-47ac-9623-9aaba4c24f08 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2b84f27c-37c3-4f7e-97f9-106b2f18a3a6 req-f061b4f5-d60b-47ac-9623-9aaba4c24f08 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2b84f27c-37c3-4f7e-97f9-106b2f18a3a6 req-f061b4f5-d60b-47ac-9623-9aaba4c24f08 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-2b84f27c-37c3-4f7e-97f9-106b2f18a3a6 req-f061b4f5-d60b-47ac-9623-9aaba4c24f08 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:33:40 user nova-compute[74048]: WARNING nova.compute.manager [req-2b84f27c-37c3-4f7e-97f9-106b2f18a3a6 req-f061b4f5-d60b-47ac-9623-9aaba4c24f08 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state building and task_state spawning.
Oct 25 16:33:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:33:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance spawned successfully.
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:33:40 user nova-compute[74048]: INFO nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Took 6.01 seconds to spawn the instance on the hypervisor.
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:33:40 user nova-compute[74048]: INFO nova.compute.manager [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Took 7.12 seconds to build instance.
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-40a522e8-7601-42dc-b6e6-60763578a8cd tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.258s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:33:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:33:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:44 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:50 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:33:50 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7133MB free_disk=25.51583480834961GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 99762562-1e2b-4518-b61c-0acb35949522 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance a2a7443a-c48d-45f0-a7d3-829931f50ce6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 29f3d942-10e2-406e-ad1c-edcf620669ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 95c95f8e-996a-4ce3-a32d-b1fe86311740 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:33:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-changed-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing instance network info cache due to event network-changed-c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing network info cache for port c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updated VIF entry in instance network info cache for port c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-64ea3f75-6a0c-4ef8-ae1a-92c0c0ebf467 req-8bdbef8d-cb82-4a0b-a7fb-100e84ca062c service nova] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:57 user nova-compute[74048]: INFO nova.compute.manager [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Shelve offloading
Oct 25 16:33:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance destroyed successfully.
Oct 25 16:33:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:33:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-unplugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-unplugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:33:59 user nova-compute[74048]: WARNING nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-unplugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state active and task_state shelving.
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:33:59 user nova-compute[74048]: WARNING nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state active and task_state shelving.
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-changed-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Refreshing instance network info cache due to event network-changed-1226b11a-beef-408e-b4b4-bf13383c8cde. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Acquiring lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Acquired lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.network.neutron [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Refreshing network info cache for port 1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:33:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance destroyed successfully.
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.objects.instance [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'resources' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-343536256',display_name='tempest-TestShelveInstance-server-343536256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-343536256',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1IrdCkUUsHiV4icGuo9klRC+AVh2R+t1h7+7dspODqRK7xS07YszymAEkMfWrLm/UKAwlnB8NXR9szHIk+yQLsI/8Et7KHEOjfK/t9THvLoo2mbxwRyL2LE80LH/RaSA==',key_name='tempest-TestShelveInstance-2011198275',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00f7ca267a294268b08d2452f427f8b2',ramdisk_id='',reservation_id='r-bcsns6bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-686947210',owner_user_name='tempest-TestShelveInstance-686947210-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:38Z,user_data=None,user_id='48ec0ba2f8824a2bacee58bf893a77d0',uuid=95c95f8e-996a-4ce3-a32d-b1fe86311740,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converting VIF {"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_vif [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc39060db-50, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-changed-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing instance network info cache due to event network-changed-c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.network.neutron [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing network info cache for port c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aabe9e2d-742e-44e4-829e-a94844549a01) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:33:59 user nova-compute[74048]: INFO os_vif [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50')
Oct 25 16:33:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:33:59 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e3ef4-f3f4-44c9-b945-a4ee16640fd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:33:59 user nova-compute[74048]: No targets found.
Oct 25 16:33:59 user nova-compute[74048]: iSNS:
Oct 25 16:33:59 user nova-compute[74048]: No targets found.
Oct 25 16:33:59 user nova-compute[74048]: STATIC:
Oct 25 16:33:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4
Oct 25 16:33:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1
Oct 25 16:33:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec
Oct 25 16:33:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44
Oct 25 16:33:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:33:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:33:59 user nova-compute[74048]: FIRMWARE:
Oct 25 16:33:59 user nova-compute[74048]: No targets found.
Oct 25 16:33:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:33:59 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:33:59 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:33:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f216ac3-89f9-4842-8f09-3c3f2070a90f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d7199-9519-4283-8d7d-f46a3fdfd9fb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:34:00 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:34:00 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:34:00 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:34:00 user nova-compute[74048]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:34:00 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:34:00 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18584209d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227d7b3-816c-4080-910e-037b12e50bd2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d37ab4-e759-40af-8bd6-3cdb37871906]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[36393975-b0bc-4ec0-9bd2-fb0b06970c49]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[27164c3a-0212-495a-a37e-59242546fcfc]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef94d11-662f-402a-95bd-8b64cdfb58ee]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ad178-6254-47a3-a191-6e86d043cc08]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]
Oct 25 16:34:00 user nova-compute[74048]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.
Oct 25 16:34:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bc96f1-a7eb-4574-8a95-554a776c5b49]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] <== disconnect_volume: return (416ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:34:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Deleting instance files /opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740_del
Oct 25 16:34:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Deletion of /opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740_del complete
Oct 25 16:34:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updated VIF entry in instance network info cache for port 1226b11a-beef-408e-b4b4-bf13383c8cde. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-af25a953-beaa-4fd0-b9f4-9f73fc4c4b7b req-bf943f96-f9a6-4cd4-aad2-3bed74db9092 service nova] Releasing lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updated VIF entry in instance network info cache for port c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": null, "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc39060db-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a6644e82-288f-4d00-a1dd-75729de95599 req-af41bf91-62e3-4359-8423-515402eb2251 service nova] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:34:01 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Deleted allocations for instance 95c95f8e-996a-4ce3-a32d-b1fe86311740
Oct 25 16:34:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:01 user nova-compute[74048]: DEBUG nova.objects.instance [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'numa_topology' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:01 user nova-compute[74048]: DEBUG nova.objects.base [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Object Instance<95c95f8e-996a-4ce3-a32d-b1fe86311740> lazy-loaded attributes: resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:34:01 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:34:01 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:34:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-63eff665-5a6d-48dd-aef2-a431da04080a tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.135s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:05 user nova-compute[74048]: INFO nova.compute.manager [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Terminating instance
Oct 25 16:34:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Instance destroyed successfully.
Oct 25 16:34:05 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'resources' on Instance uuid 99762562-1e2b-4518-b61c-0acb35949522 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-283217924',display_name='tempest-AttachVolumeNegativeTest-server-283217924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-283217924',id=13,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqe9bom7TnMW7eu+3LPUqovy61OgYWGU8jMbX0FPpdwRkECh9GL3sQzHS0PImPMBg8ltYOZwPxCl0aMyL64RVD8uLAl1K6YP45lbUekoryResqkoYySsCCUUKjppLq0MQ==',key_name='tempest-keypair-390159991',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-al3gtjxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=99762562-1e2b-4518-b61c-0acb35949522,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "address": "fa:16:3e:3c:86:f3", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d524b5-63", "ovs_interfaceid": "e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG os_vif [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2d524b5-63, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6a31c7a-0b30-433e-ac24-90fd1a59b7b3) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:06 user nova-compute[74048]: INFO os_vif [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:86:f3,bridge_name='br-int',has_traffic_filtering=True,id=e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d524b5-63')
Oct 25 16:34:06 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Deleting instance files /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522_del
Oct 25 16:34:06 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Deletion of /opt/stack/data/nova/instances/99762562-1e2b-4518-b61c-0acb35949522_del complete
Oct 25 16:34:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-43ebf3ef-7d5d-4143-93c6-2268f46937b7 req-fde85e12-9f8e-4e2d-b9ac-3b32777a96e8 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-vif-unplugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-43ebf3ef-7d5d-4143-93c6-2268f46937b7 req-fde85e12-9f8e-4e2d-b9ac-3b32777a96e8 service nova] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-43ebf3ef-7d5d-4143-93c6-2268f46937b7 req-fde85e12-9f8e-4e2d-b9ac-3b32777a96e8 service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-43ebf3ef-7d5d-4143-93c6-2268f46937b7 req-fde85e12-9f8e-4e2d-b9ac-3b32777a96e8 service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-43ebf3ef-7d5d-4143-93c6-2268f46937b7 req-fde85e12-9f8e-4e2d-b9ac-3b32777a96e8 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] No waiting events found dispatching network-vif-unplugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-43ebf3ef-7d5d-4143-93c6-2268f46937b7 req-fde85e12-9f8e-4e2d-b9ac-3b32777a96e8 service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-vif-unplugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:06 user nova-compute[74048]: INFO nova.compute.manager [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 25 16:34:06 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 99762562-1e2b-4518-b61c-0acb35949522] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:06 user nova-compute[74048]: INFO nova.compute.manager [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Shelving
Oct 25 16:34:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance destroyed successfully.
Oct 25 16:34:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Beginning cold snapshot process
Oct 25 16:34:07 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:34:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk /opt/stack/data/nova/instances/snapshots/tmp42jzx39w/b2ad21088b9b4d82832124f74214bddc {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Acquiring lock "99762562-1e2b-4518-b61c-0acb35949522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Lock "99762562-1e2b-4518-b61c-0acb35949522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] No waiting events found dispatching network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:08 user nova-compute[74048]: WARNING nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received unexpected event network-vif-plugged-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 for instance with vm_state active and task_state deleting.
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-unplugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-unplugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:08 user nova-compute[74048]: WARNING nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-unplugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:08 user nova-compute[74048]: WARNING nova.compute.manager [req-78a9e061-e411-4a65-8c7d-c04f429169e5 req-b6d8e97d-cad4-4b52-91f9-ba7edcbea86c service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk /opt/stack/data/nova/instances/snapshots/tmp42jzx39w/b2ad21088b9b4d82832124f74214bddc" returned: 0 in 1.036s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Snapshot extracted, beginning image upload
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:08 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Took 2.16 seconds to deallocate network for instance.
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:34:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:08 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Deleted allocations for instance 99762562-1e2b-4518-b61c-0acb35949522
Oct 25 16:34:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f02574ad-cb7b-426a-932d-dd2bb0e9d4f4 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "99762562-1e2b-4518-b61c-0acb35949522" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.825s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-changed-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Refreshing instance network info cache due to event network-changed-82dbd447-aff0-4c3e-ac60-7395297d3844. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] Acquiring lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] Acquired lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Refreshing network info cache for port 82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-changed-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing instance network info cache due to event network-changed-69f1479f-5ad1-46a0-8b8d-09a9b75c63af. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] Acquiring lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] Acquired lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Refreshing network info cache for port 69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updated VIF entry in instance network info cache for port 82dbd447-aff0-4c3e-ac60-7395297d3844. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updating instance_info_cache with network_info: [{"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6c0119c5-4887-4026-9581-c750a14843dc req-2527e704-259c-4161-9c52-2dd1d332d140 service nova] Releasing lock "refresh_cache-0ad0d06b-51a7-469a-a11d-2416c00b94f1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updated VIF entry in instance network info cache for port 69f1479f-5ad1-46a0-8b8d-09a9b75c63af. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:10 user nova-compute[74048]: INFO nova.compute.manager [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Terminating instance
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] Releasing lock "refresh_cache-29f3d942-10e2-406e-ad1c-edcf620669ba" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-5c06c567-c1be-418d-b550-54f4722e0e2c req-b9e2b712-2fe6-43ce-b6f6-cd2570b28ecc service nova] [instance: 99762562-1e2b-4518-b61c-0acb35949522] Received event network-vif-deleted-e2d524b5-63d9-4cbf-ba97-bd2ebb1362d1 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'flavor' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-23b47ae3-7f21-4685-b532-85e12632920e req-c01b9a7a-3858-4ca8-a6c3-b30a48f5af08 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-23b47ae3-7f21-4685-b532-85e12632920e req-c01b9a7a-3858-4ca8-a6c3-b30a48f5af08 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-23b47ae3-7f21-4685-b532-85e12632920e req-c01b9a7a-3858-4ca8-a6c3-b30a48f5af08 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-23b47ae3-7f21-4685-b532-85e12632920e req-c01b9a7a-3858-4ca8-a6c3-b30a48f5af08 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-23b47ae3-7f21-4685-b532-85e12632920e req-c01b9a7a-3858-4ca8-a6c3-b30a48f5af08 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-23b47ae3-7f21-4685-b532-85e12632920e req-c01b9a7a-3858-4ca8-a6c3-b30a48f5af08 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:11 user nova-compute[74048]: INFO nova.compute.manager [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attaching volume c9dce109-40f9-434a-986c-d460508f3f29 to /dev/vdb
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG os_brick.utils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Snapshot image upload complete
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e2c3ec-83ed-4e85-bdfb-4ccda3011525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f025c-fedd-49c3-bc6d-631376ed7daf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c91cb78-5e88-4ae7-b5b6-610a9b2c9efc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe84213-d04c-4593-86f2-d6ea0a996eac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: INFO nova.compute.manager [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Shelve offloading
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:34:11 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[84604648-8991-4853-8a77-a2b209b6bcb7]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG os_brick.utils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] <== get_connector_properties: return (226ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updating existing volume attachment record: b55fc0c9-cfea-4f40-9eb8-73ce448611f5 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:34:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance destroyed successfully.
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquired lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-7de34878-3091-4940-a4dd-8acede7c3b91 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: WARNING nova.compute.manager [req-a9e2ef93-5148-474b-bc57-24dc63911f27 req-eb0d8a84-f58c-4600-b1f6-69fa98d280a4 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-7de34878-3091-4940-a4dd-8acede7c3b91 for instance with vm_state active and task_state deleting.
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: WARNING nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-8a65faba-5a1b-452f-bc3e-e93c5eacf43d for instance with vm_state active and task_state deleting.
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: WARNING nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-3d8f2e36-9f90-4fcc-86b1-40bbac58200d for instance with vm_state active and task_state deleting.
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-cd42c233-256a-4895-ada0-2957069b74a4 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:12 user nova-compute[74048]: WARNING nova.compute.manager [req-67ac8aa8-3d4d-4c1c-a1cd-45750203f7a2 req-d84ff9e3-9f95-403a-9f06-be3f69623067 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-cd42c233-256a-4895-ada0-2957069b74a4 for instance with vm_state active and task_state deleting.
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Instance destroyed successfully.
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lazy-loading 'resources' on Instance uuid 29f3d942-10e2-406e-ad1c-edcf620669ba {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69f1479f-5a, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=278f3bab-5c23-4dc7-8c45-a4c017743687) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Releasing lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:34:12 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=69f1479f-5ad1-46a0-8b8d-09a9b75c63af,network=Network(60e625b1-e783-4f22-9518-c23dc61127ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f1479f-5a')
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a65faba-5a, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16e935fe-7d39-465d-bc3d-f76a6ca984df) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:41,bridge_name='br-int',has_traffic_filtering=True,id=8a65faba-5a1b-452f-bc3e-e93c5eacf43d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a65faba-5a')
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30f96d6a-af, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e036a1d5-9951-4447-9afc-505de1644898) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:67:ca,bridge_name='br-int',has_traffic_filtering=True,id=30f96d6a-afbf-4426-a047-1de09c23013e,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap30f96d6a-af')
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "address": "fa:16:3e:ed:66:7c", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d8f2e36-9f", "ovs_interfaceid": "3d8f2e36-9f90-4fcc-86b1-40bbac58200d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d8f2e36-9f, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7908e8b-a41c-4158-a7aa-e99ca3baec4e) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:66:7c,bridge_name='br-int',has_traffic_filtering=True,id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d8f2e36-9f')
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7de34878-30, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=055dcc18-4c98-4842-8c59-88365d95ba1c) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:13 user nova-compute[74048]: WARNING nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-69f1479f-5ad1-46a0-8b8d-09a9b75c63af for instance with vm_state active and task_state deleting.
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-30f96d6a-afbf-4426-a047-1de09c23013e for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:13 user nova-compute[74048]: WARNING nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-30f96d6a-afbf-4426-a047-1de09c23013e for instance with vm_state active and task_state deleting.
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-unplugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-unplugged-78ac2898-af27-4f38-9ed2-f974a9f40354 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Acquiring lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] No waiting events found dispatching network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:13 user nova-compute[74048]: WARNING nova.compute.manager [req-f41ac6d9-a823-4ab0-9575-7860da3fcb1e req-feeaa564-32dd-41ea-9486-7cb25edd63a2 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received unexpected event network-vif-plugged-78ac2898-af27-4f38-9ed2-f974a9f40354 for instance with vm_state active and task_state deleting.
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2b:c8,bridge_name='br-int',has_traffic_filtering=True,id=7de34878-3091-4940-a4dd-8acede7c3b91,network=Network(89b19b78-799e-4124-b823-fcd882340f56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de34878-30')
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78ac2898-af, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=188c1302-272f-4f94-9c27-b900d33a32e4) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:3e:7c,bridge_name='br-int',has_traffic_filtering=True,id=78ac2898-af27-4f38-9ed2-f974a9f40354,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78ac2898-af')
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T16:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2140185194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2140185194',id=16,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD0hI7vNTmbhEbWdCkoLkQJEmOym1YKlujieLCIhucc6P85MRAO6od7ikjkhiiFmWJy9DOR9mfqM7TnVCz+mqMdFsBN298LBVE1Ssz8Md4InVAglCQNzZc4c0an04tIAQ==',key_name='tempest-keypair-438660425',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3c3b7a86214d47abe65768b55f57ed',ramdisk_id='',reservation_id='r-zj1sb125',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300142545',owner_user_name='tempest-TaggedBootDevicesTest-1300142545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9635f75f43d4f3ba9de24d0b9c0b5b0',uuid=29f3d942-10e2-406e-ad1c-edcf620669ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converting VIF {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd42c233-25, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ecab8cf-0cda-4e6f-9abe-80f19dfd5ce1) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:35:7d,bridge_name='br-int',has_traffic_filtering=True,id=cd42c233-256a-4895-ada0-2957069b74a4,network=Network(1909f428-c76b-43f6-be3e-3163f8f80065),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd42c233-25')
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMzpJwbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:13 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[663722b3-fcf3-49fe-bd02-3071739aab6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:34:13 user nova-compute[74048]: No targets found.
Oct 25 16:34:13 user nova-compute[74048]: iSNS:
Oct 25 16:34:13 user nova-compute[74048]: No targets found.
Oct 25 16:34:13 user nova-compute[74048]: STATIC:
Oct 25 16:34:13 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4
Oct 25 16:34:13 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:34:13 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:34:13 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1
Oct 25 16:34:13 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:34:13 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:34:13 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec
Oct 25 16:34:13 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:34:13 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:34:13 user nova-compute[74048]: FIRMWARE:
Oct 25 16:34:13 user nova-compute[74048]: No targets found.
Oct 25 16:34:13 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:34:13 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:34:13 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance destroyed successfully.
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.objects.instance [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'resources' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a00402-1189-437e-88cd-b23f8df0adf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-93929825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-93929825',id=18,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvvFjuGaODPDW3M0J8/43pwh8ovPqWKy/dy6XY1+h7DMUpnq2te7GFJeDZmlimngWhcsv+bxmsRq1r2zKhBX75jBabs+k3r1xodY2EuyVOk5Qy22mOGLVhxGqu212ChZA==',key_name='tempest-keypair-513469368',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-8ltesbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member',shelved_at='2023-10-25T16:34:11.658361',shelved_host='user',shelved_image_id='677be60e-fb60-4d7d-b9f8-9b1829a9ed68'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=30783ca1-6eb2-4c19-907c-f4e84ca696ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_vif [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1226b11a-be, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fda295d-540a-4e72-ac5e-4c7b0eb095f4) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: INFO os_vif [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be')
Oct 25 16:34:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Deleting instance files /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac_del
Oct 25 16:34:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Deletion of /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac_del complete
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[596addfe-d4a6-4787-8536-3ae690040c5a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:34:13 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:34:13 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:13 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 (non-flash)
Oct 25 16:34:13 user nova-compute[74048]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:34:13 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:13 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840439360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d41ad60-f8f0-42c2-9e99-7d296ffb97bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[63006479-12a4-4302-bfc8-31c693e7ad5a]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3ff9f2-5a7a-4859-9da0-cd0b5b01bd44]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[316dbdb7-4dbb-4f1e-b3c3-37bc3541473c]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:34:13 user nova-compute[74048]: INFO nova.compute.manager [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Terminating instance
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:34:13 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Deleted allocations for instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03f8adf-86d3-4d49-9fbc-e170c7fde0ca]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.objects.instance [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'numa_topology' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.objects.base [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<30783ca1-6eb2-4c19-907c-f4e84ca696ac> lazy-loaded attributes: resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0491cccb-d4fd-432b-8a70-90b372012253]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260]
Oct 25 16:34:13 user nova-compute[74048]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4, portal: 172.16.0.220,3260] successful.
Oct 25 16:34:13 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23176799-afe8-4224-af4f-32405d2889c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f237469e-e6a7-429b-9e55-02feff988354]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== disconnect_volume: return (410ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjlrwVgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:13 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb80ad29-2810-4561-8be9-1cdf04d7e8e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:34:14 user nova-compute[74048]: No targets found.
Oct 25 16:34:14 user nova-compute[74048]: iSNS:
Oct 25 16:34:14 user nova-compute[74048]: No targets found.
Oct 25 16:34:14 user nova-compute[74048]: STATIC:
Oct 25 16:34:14 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1
Oct 25 16:34:14 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:34:14 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:34:14 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec
Oct 25 16:34:14 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:34:14 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:34:14 user nova-compute[74048]: FIRMWARE:
Oct 25 16:34:14 user nova-compute[74048]: No targets found.
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:34:14 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:34:14 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d81c95e-81b1-421b-a232-4a181a675f61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8b245-0c7a-4c9d-bba2-8064f42aa661]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:34:14 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 (non-flash)
Oct 25 16:34:14 user nova-compute[74048]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185024e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1'): ({'sdd'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Removing single pathed devices sdd {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b48528-d124-4da7-aa8c-be1cc0f18d0a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9817f686-1975-4953-b50e-8e62a435c547]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Flushing IO for device /dev/sdd {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0121f38-90df-4e8d-8f7c-d5019e5c7102]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3533ec00-e25c-43f4-bc96-cb32cd1da3fa]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf9589e-3a62-4cb5-a3e0-20a457d71d33]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-be76c974-3799-439d-812b-f4edc81b034a req-31ad7cff-8a59-45e1-b95a-dde73daab041 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-vif-unplugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-be76c974-3799-439d-812b-f4edc81b034a req-31ad7cff-8a59-45e1-b95a-dde73daab041 service nova] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-be76c974-3799-439d-812b-f4edc81b034a req-31ad7cff-8a59-45e1-b95a-dde73daab041 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-be76c974-3799-439d-812b-f4edc81b034a req-31ad7cff-8a59-45e1-b95a-dde73daab041 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-be76c974-3799-439d-812b-f4edc81b034a req-31ad7cff-8a59-45e1-b95a-dde73daab041 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] No waiting events found dispatching network-vif-unplugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-be76c974-3799-439d-812b-f4edc81b034a req-31ad7cff-8a59-45e1-b95a-dde73daab041 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-vif-unplugged-6f95b356-29b3-4197-b96c-4d43b769bef8 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f40518-fe21-454b-8687-b31dfca57e6e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260]
Oct 25 16:34:14 user nova-compute[74048]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1, portal: 172.16.0.220,3260] successful.
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-49b742c3-12c8-422f-a842-1fc8eb8dad01 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.985s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef4d6ab3-93f7-4242-a5b3-4e483a37b4c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f287337-7cc4-4b38-ada7-f9f87f29000d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== disconnect_volume: return (430ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbFiHket', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0409c6-b523-4723-8e98-0c4e64de7346]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:34:14 user nova-compute[74048]: No targets found.
Oct 25 16:34:14 user nova-compute[74048]: iSNS:
Oct 25 16:34:14 user nova-compute[74048]: No targets found.
Oct 25 16:34:14 user nova-compute[74048]: STATIC:
Oct 25 16:34:14 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec
Oct 25 16:34:14 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:34:14 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:34:14 user nova-compute[74048]: FIRMWARE:
Oct 25 16:34:14 user nova-compute[74048]: No targets found.
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:34:14 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:34:14 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a0742-276d-46cb-900f-6ed4877f68de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a8fe26-b9ee-4613-b690-6e05cd4ca004]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec (non-flash)
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18580cda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec'): ({'sde'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Removing single pathed devices sde {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1d34ab-6ded-4b80-a599-0b7965ad7ddd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7794dc03-563b-4f34-a28f-9befe6305b9e]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Flushing IO for device /dev/sde {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572ab14-1ed6-40ef-9d49-9299f1a9cee8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Instance destroyed successfully.
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.objects.instance [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lazy-loading 'resources' on Instance uuid a2a7443a-c48d-45f0-a7d3-829931f50ce6 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-656517393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6565173',id=15,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQu8qUFmQkJq3k3ZBwop1cSeIhsygJxM3z946w3jOLMFSv59ND2k/6VHaK9gtWrq1L1miVwNbTTTPdmP/TfVfkwxfnG+o+5dk+WywDY6o9bCVrSXd2nNElON8Bhu25siw==',key_name='tempest-keypair-1692789204',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e13c71cbaec42c0bed605da609fa4da',ramdisk_id='',reservation_id='r-b03ffkud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1383948749',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90163fcc508143cc867e2c9e1cac5818',uuid=a2a7443a-c48d-45f0-a7d3-829931f50ce6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Converting VIF {"id": "6f95b356-29b3-4197-b96c-4d43b769bef8", "address": "fa:16:3e:4d:d1:60", "network": {"id": "bde6fcc1-d4fb-40cd-b624-14656d0fc14d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-135002929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e13c71cbaec42c0bed605da609fa4da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f95b356-29", "ovs_interfaceid": "6f95b356-29b3-4197-b96c-4d43b769bef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_vif [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f95b356-29, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a0c9e3-397a-4669-86f8-98df697d37dc]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdd40eb6-3864-4804-8e11-b708c72130d6) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:14 user nova-compute[74048]: INFO os_vif [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:d1:60,bridge_name='br-int',has_traffic_filtering=True,id=6f95b356-29b3-4197-b96c-4d43b769bef8,network=Network(bde6fcc1-d4fb-40cd-b624-14656d0fc14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f95b356-29')
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Deleting instance files /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6_del
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Deletion of /opt/stack/data/nova/instances/a2a7443a-c48d-45f0-a7d3-829931f50ce6_del complete
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8be225-61c2-452e-b5d3-cdf5aa9822f1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.compute.manager [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca8448d-bb0c-4386-a490-44b0661a8556]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260]
Oct 25 16:34:14 user nova-compute[74048]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec, portal: 172.16.0.220,3260] successful.
Oct 25 16:34:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd99f035-d66b-40cc-bff2-301662a34bec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7831b3-5b2a-4cf0-b983-51dbb02e8219]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] <== disconnect_volume: return (316ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Deleting instance files /opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba_del
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Deletion of /opt/stack/data/nova/instances/29f3d942-10e2-406e-ad1c-edcf620669ba_del complete
Oct 25 16:34:14 user nova-compute[74048]: INFO nova.compute.manager [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Took 3.93 seconds to destroy the instance on the hypervisor.
Oct 25 16:34:14 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:34:14 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:34:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:15 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:15 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Took 0.83 seconds to deallocate network for instance.
Oct 25 16:34:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:16 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Deleted allocations for instance a2a7443a-c48d-45f0-a7d3-829931f50ce6
Oct 25 16:34:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ad008135-d65c-40bf-af4e-d459c752c0fa tempest-TestServerVolumeAttachScenarioOldVersion-1383948749 tempest-TestServerVolumeAttachScenarioOldVersion-1383948749-project-member] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e6a27fc-de5f-4564-871e-a5df8e0b3e29 req-b9182499-2ba6-43c4-92e5-0943f3e1c256 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e6a27fc-de5f-4564-871e-a5df8e0b3e29 req-b9182499-2ba6-43c4-92e5-0943f3e1c256 service nova] Acquiring lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e6a27fc-de5f-4564-871e-a5df8e0b3e29 req-b9182499-2ba6-43c4-92e5-0943f3e1c256 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e6a27fc-de5f-4564-871e-a5df8e0b3e29 req-b9182499-2ba6-43c4-92e5-0943f3e1c256 service nova] Lock "a2a7443a-c48d-45f0-a7d3-829931f50ce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e6a27fc-de5f-4564-871e-a5df8e0b3e29 req-b9182499-2ba6-43c4-92e5-0943f3e1c256 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] No waiting events found dispatching network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:34:16 user nova-compute[74048]: WARNING nova.compute.manager [req-5e6a27fc-de5f-4564-871e-a5df8e0b3e29 req-b9182499-2ba6-43c4-92e5-0943f3e1c256 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received unexpected event network-vif-plugged-6f95b356-29b3-4197-b96c-4d43b769bef8 for instance with vm_state deleted and task_state None.
Oct 25 16:34:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-d03271e5-2134-4d0f-928a-c790f20b2e04 req-bac16fcd-7ed5-48a0-a741-451d474f1628 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-deleted-3d8f2e36-9f90-4fcc-86b1-40bbac58200d {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:17 user nova-compute[74048]: INFO nova.compute.manager [req-d03271e5-2134-4d0f-928a-c790f20b2e04 req-bac16fcd-7ed5-48a0-a741-451d474f1628 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Neutron deleted interface 3d8f2e36-9f90-4fcc-86b1-40bbac58200d; detaching it from the instance and deleting it from the info cache
Oct 25 16:34:17 user nova-compute[74048]: DEBUG nova.network.neutron [req-d03271e5-2134-4d0f-928a-c790f20b2e04 req-bac16fcd-7ed5-48a0-a741-451d474f1628 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [{"id": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "address": "fa:16:3e:5e:7b:e7", "network": {"id": "60e625b1-e783-4f22-9518-c23dc61127ed", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-490743572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f1479f-5a", "ovs_interfaceid": "69f1479f-5ad1-46a0-8b8d-09a9b75c63af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "address": "fa:16:3e:40:f3:41", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a65faba-5a", "ovs_interfaceid": "8a65faba-5a1b-452f-bc3e-e93c5eacf43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30f96d6a-afbf-4426-a047-1de09c23013e", "address": "fa:16:3e:ca:67:ca", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f96d6a-af", "ovs_interfaceid": "30f96d6a-afbf-4426-a047-1de09c23013e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7de34878-3091-4940-a4dd-8acede7c3b91", "address": "fa:16:3e:93:2b:c8", "network": {"id": "89b19b78-799e-4124-b823-fcd882340f56", "bridge": "br-int", "label": "tempest-device-tagging-net1-1674853566", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de34878-30", "ovs_interfaceid": "7de34878-3091-4940-a4dd-8acede7c3b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78ac2898-af27-4f38-9ed2-f974a9f40354", "address": "fa:16:3e:72:3e:7c", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78ac2898-af", "ovs_interfaceid": "78ac2898-af27-4f38-9ed2-f974a9f40354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd42c233-256a-4895-ada0-2957069b74a4", "address": "fa:16:3e:22:35:7d", "network": {"id": "1909f428-c76b-43f6-be3e-3163f8f80065", "bridge": "br-int", "label": "tempest-device-tagging-net2-225685784", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ba3c3b7a86214d47abe65768b55f57ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd42c233-25", "ovs_interfaceid": "cd42c233-256a-4895-ada0-2957069b74a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-d03271e5-2134-4d0f-928a-c790f20b2e04 req-bac16fcd-7ed5-48a0-a741-451d474f1628 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Detach interface failed, port_id=3d8f2e36-9f90-4fcc-86b1-40bbac58200d, reason: Instance 29f3d942-10e2-406e-ad1c-edcf620669ba could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:34:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-8a5ff01c-6a26-4fd0-b731-bc22c44d6c67 req-30f2b64b-6f21-4aff-81d9-f42cfb0fe969 service nova] [instance: a2a7443a-c48d-45f0-a7d3-829931f50ce6] Received event network-vif-deleted-6f95b356-29b3-4197-b96c-4d43b769bef8 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:19 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:19 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Took 4.22 seconds to deallocate network for instance.
Oct 25 16:34:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-d82ae509-5276-46f4-b9d5-f855d6502990 req-716de3b8-bdb3-4dd3-b068-fcacbe378204 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-deleted-cd42c233-256a-4895-ada0-2957069b74a4 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-d82ae509-5276-46f4-b9d5-f855d6502990 req-716de3b8-bdb3-4dd3-b068-fcacbe378204 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-deleted-69f1479f-5ad1-46a0-8b8d-09a9b75c63af {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-d82ae509-5276-46f4-b9d5-f855d6502990 req-716de3b8-bdb3-4dd3-b068-fcacbe378204 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-deleted-78ac2898-af27-4f38-9ed2-f974a9f40354 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-d82ae509-5276-46f4-b9d5-f855d6502990 req-716de3b8-bdb3-4dd3-b068-fcacbe378204 service nova] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Received event network-vif-deleted-7de34878-3091-4940-a4dd-8acede7c3b91 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:34:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:34:21 user nova-compute[74048]: INFO nova.compute.manager [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] instance snapshotting
Oct 25 16:34:21 user nova-compute[74048]: INFO nova.compute.manager [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] [instance: 29f3d942-10e2-406e-ad1c-edcf620669ba] Took 2.85 seconds to detach 3 volumes for instance.
Oct 25 16:34:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Beginning live snapshot process
Oct 25 16:34:22 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:22 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Deleted allocations for instance 29f3d942-10e2-406e-ad1c-edcf620669ba
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a48f6e35-1457-48ba-ab8d-c03a9f5b56e1 tempest-TaggedBootDevicesTest-1300142545 tempest-TaggedBootDevicesTest-1300142545-project-member] Lock "29f3d942-10e2-406e-ad1c-edcf620669ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.587s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.251s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpax1hawdq/4d752fab3fd74aeeb9c582fff1a1faee.delta 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpax1hawdq/4d752fab3fd74aeeb9c582fff1a1faee.delta 1073741824" returned: 0 in 0.053s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 16:34:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:34:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:34:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 16:34:24 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:34:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpax1hawdq/4d752fab3fd74aeeb9c582fff1a1faee.delta /opt/stack/data/nova/instances/snapshots/tmpax1hawdq/4d752fab3fd74aeeb9c582fff1a1faee {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpax1hawdq/4d752fab3fd74aeeb9c582fff1a1faee.delta /opt/stack/data/nova/instances/snapshots/tmpax1hawdq/4d752fab3fd74aeeb9c582fff1a1faee" returned: 0 in 0.427s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Snapshot extracted, beginning image upload
Oct 25 16:34:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Snapshot image upload complete
Oct 25 16:34:27 user nova-compute[74048]: INFO nova.compute.manager [None req-1a0f2ab3-5cda-41b0-9dba-7b0b465d9627 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Took 5.85 seconds to snapshot the instance on the hypervisor.
Oct 25 16:34:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAOkrKog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:31 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:31 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:31 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91e1397-9d81-4946-a800-d2f806fe22a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:34:31 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860544d-8292-4ddb-afb4-753d0897114e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29] added
Oct 25 16:34:31 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf52bd-7695-4f59-b20b-30491a6b5a9d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de0258-abc1-404b-a60a-c0a6359958fb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uAOkrKog {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uAOkrKog" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce2db8-dc73-4e12-90b3-94ace0ea36b9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uAOkrKog'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eb8746-4d16-43c9-a181-746b2a2cf9d0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dfa929-38fb-4861-918c-c3c929ad7582]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:34:31 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:34:31 user nova-compute[74048]:  {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:31 user nova-compute[74048]: WARNING os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 16:34:31 user nova-compute[74048]: 
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a8e9c-31fa-4656-a98a-a8fc5ec0a58a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260]
Oct 25 16:34:31 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260] successful.
Oct 25 16:34:31 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8627410-e87a-40cd-ad6b-8fc80de2f031]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6841b0-c9fd-4882-a59c-99f353a89e3c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:34:31 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:34:31 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5ab0c0-b70c-4d39-8b8b-3d5a524470b6]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:34:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAOkrKog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26639643135663962', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639643135663962', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'flavor' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:34:32 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:34:32 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:34:32 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:34:32 user nova-compute[74048]:   <serial>c9dce109-40f9-434a-986c-d460508f3f29</serial>
Oct 25 16:34:32 user nova-compute[74048]: </disk>
Oct 25 16:34:32 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:34:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No VIF found with MAC fa:16:3e:be:18:42, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:34:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3754f713-7d0a-4f34-8168-3f9f871add91 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.568s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG nova.objects.instance [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'flavor' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:36 user nova-compute[74048]: INFO nova.compute.manager [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attaching volume bdd58b2e-bc00-45f5-815b-bb09f0d54e36 to /dev/vdc
Oct 25 16:34:36 user nova-compute[74048]: DEBUG os_brick.utils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a113c1e-4287-4f3f-a6e1-220769ef92b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d138cbc-921e-4e93-b3be-6c912e3a91f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4342671-cf51-4096-aa94-f9ae2675ad75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a2f43-0c4d-4899-870d-97c46e0adcdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:34:36 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:34:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8769f01a-1b46-436f-b7ed-54ea0f7e7669]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG os_brick.utils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:36 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updating existing volume attachment record: 2f8544a0-d93d-47fb-8962-c3011bc649e8 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:34:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:34:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:44 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:48 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:34:48 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=25.459369659423828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:34:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:34:49 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:34:49 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:34:49 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:34:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfltHVgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:34:54 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:54 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:34:54 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55a13ed-b327-4675-ab6e-5a56d38793be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:34:54 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88f5008-7014-4daa-9885-631adc6f0b61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36] added
Oct 25 16:34:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c272f597-7056-4fa3-b06d-657e351e0605]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad12579-fb7e-415a-8c15-f31fdaa2fbf8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfltHVgW {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfltHVgW" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9105f1a-93fc-4e61-b9e8-79edda192564]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfltHVgW'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605928c-c5fa-4bf1-be2e-d2bd74346f6f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6197497-7125-4656-87c1-4db8c2238edb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:34:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:34:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb06bb-f920-4837-89be-09df8c464eab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260]
Oct 25 16:34:54 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260] successful.
Oct 25 16:34:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.060s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee74162-e948-4641-aaf4-10a358c9aa47]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7a77cf-8afc-4231-bd99-4642bc0b8413]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:34:54 user nova-compute[74048]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 (non-flash)
Oct 25 16:34:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:34:54 user nova-compute[74048]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 (non-flash)
Oct 25 16:34:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc45a1ed-86de-40c5-96e0-14686ca24a10]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:34:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfltHVgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:34:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:34:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26565356166396339', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:34:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565356166396339', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:34:55 user nova-compute[74048]: DEBUG nova.objects.instance [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'flavor' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:34:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:34:55 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:34:55 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:34:55 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 16:34:55 user nova-compute[74048]:   <serial>bdd58b2e-bc00-45f5-815b-bb09f0d54e36</serial>
Oct 25 16:34:55 user nova-compute[74048]: </disk>
Oct 25 16:34:55 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:34:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:34:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:34:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:34:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] No VIF found with MAC fa:16:3e:be:18:42, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:34:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6b2a1457-2f80-4646-8fdd-38e09deaf0fd tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.782s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:34:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:57 user nova-compute[74048]: INFO nova.compute.manager [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Detaching volume bdd58b2e-bc00-45f5-815b-bb09f0d54e36
Oct 25 16:34:57 user nova-compute[74048]: INFO nova.virt.block_device [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attempting to driver detach volume bdd58b2e-bc00-45f5-815b-bb09f0d54e36 from mountpoint /dev/vdc
Oct 25 16:34:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Attempting to detach device vdc from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:34:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:34:57 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:34:57 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:34:57 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 16:34:57 user nova-compute[74048]:   <serial>bdd58b2e-bc00-45f5-815b-bb09f0d54e36</serial>
Oct 25 16:34:57 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 16:34:57 user nova-compute[74048]: </disk>
Oct 25 16:34:57 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:34:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Successfully detached device vdc from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the persistent domain config.
Oct 25 16:34:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:34:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:34:57 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:34:57 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:34:57 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 16:34:57 user nova-compute[74048]:   <serial>bdd58b2e-bc00-45f5-815b-bb09f0d54e36</serial>
Oct 25 16:34:57 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 16:34:57 user nova-compute[74048]: </disk>
Oct 25 16:34:57 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:34:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:34:59 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:34:59 user nova-compute[74048]: INFO nova.compute.claims [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Claim successful on node user
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.network.neutron [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:35:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.policy [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c18414d5c9d7450ca96521eabe2a002d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add2dbb4f18f41b291725ab0073ebd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:35:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Creating image(s)
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "/opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "/opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "/opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk 1073741824" returned: 0 in 0.055s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.network.neutron [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Successfully created port: 12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:35:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Cannot resize image /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Ensure instance console log exists: /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.neutron [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Successfully updated port: 12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquired lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.neutron [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.compute.manager [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-changed-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.compute.manager [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Refreshing instance network info cache due to event network-changed-12a1be3f-29dd-4dfc-8be7-77df08c2c23e. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] Acquiring lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.neutron [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.neutron [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updating instance_info_cache with network_info: [{"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Releasing lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Instance network_info: |[{"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] Acquired lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.neutron [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Refreshing network info cache for port 12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Start _get_guest_xml network_info=[{"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:35:01 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:01 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1499400529',display_name='tempest-AttachVolumeNegativeTest-server-1499400529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1499400529',id=23,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu+Vb9olSog0NENb0JydaT8Ro8ry7jbASxsp12gjj4nVboFaid+URjU88lMGSDro9+QjF5QlFOwvVX82eOItn+tza4crMOJsbxkTWr47bBvYsty+AErLs22W32H+xvR/g==',key_name='tempest-keypair-114412920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-vb10w5yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=105119ce-b27f-41a7-b466-2f6b1ca03077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:01 user nova-compute[74048]: DEBUG nova.objects.instance [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'pci_devices' on Instance uuid 105119ce-b27f-41a7-b466-2f6b1ca03077 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:35:02 user nova-compute[74048]:   <uuid>105119ce-b27f-41a7-b466-2f6b1ca03077</uuid>
Oct 25 16:35:02 user nova-compute[74048]:   <name>instance-00000017</name>
Oct 25 16:35:02 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:35:02 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:35:02 user nova-compute[74048]:   <metadata>
Oct 25 16:35:02 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:35:02 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:35:02 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1499400529</nova:name>
Oct 25 16:35:02 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:35:01</nova:creationTime>
Oct 25 16:35:02 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:35:02 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:35:02 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:35:02 user nova-compute[74048]:       <nova:owner>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:user uuid="c18414d5c9d7450ca96521eabe2a002d">tempest-AttachVolumeNegativeTest-1660122620-project-member</nova:user>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:project uuid="add2dbb4f18f41b291725ab0073ebd37">tempest-AttachVolumeNegativeTest-1660122620</nova:project>
Oct 25 16:35:02 user nova-compute[74048]:       </nova:owner>
Oct 25 16:35:02 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:35:02 user nova-compute[74048]:       <nova:ports>
Oct 25 16:35:02 user nova-compute[74048]:         <nova:port uuid="12a1be3f-29dd-4dfc-8be7-77df08c2c23e">
Oct 25 16:35:02 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 16:35:02 user nova-compute[74048]:         </nova:port>
Oct 25 16:35:02 user nova-compute[74048]:       </nova:ports>
Oct 25 16:35:02 user nova-compute[74048]:     </nova:instance>
Oct 25 16:35:02 user nova-compute[74048]:   </metadata>
Oct 25 16:35:02 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:35:02 user nova-compute[74048]:     <system>
Oct 25 16:35:02 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:35:02 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:35:02 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:35:02 user nova-compute[74048]:       <entry name="serial">105119ce-b27f-41a7-b466-2f6b1ca03077</entry>
Oct 25 16:35:02 user nova-compute[74048]:       <entry name="uuid">105119ce-b27f-41a7-b466-2f6b1ca03077</entry>
Oct 25 16:35:02 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:35:02 user nova-compute[74048]:     </system>
Oct 25 16:35:02 user nova-compute[74048]:   </sysinfo>
Oct 25 16:35:02 user nova-compute[74048]:   <os>
Oct 25 16:35:02 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:35:02 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:35:02 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:35:02 user nova-compute[74048]:   </os>
Oct 25 16:35:02 user nova-compute[74048]:   <features>
Oct 25 16:35:02 user nova-compute[74048]:     <acpi/>
Oct 25 16:35:02 user nova-compute[74048]:     <apic/>
Oct 25 16:35:02 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:35:02 user nova-compute[74048]:   </features>
Oct 25 16:35:02 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:35:02 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:35:02 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:35:02 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:35:02 user nova-compute[74048]:   </clock>
Oct 25 16:35:02 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:35:02 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:35:02 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:35:02 user nova-compute[74048]:   </cpu>
Oct 25 16:35:02 user nova-compute[74048]:   <devices>
Oct 25 16:35:02 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:35:02 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:35:02 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk"/>
Oct 25 16:35:02 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:35:02 user nova-compute[74048]:     </disk>
Oct 25 16:35:02 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:35:02 user nova-compute[74048]:       <mac address="fa:16:3e:a4:ed:c2"/>
Oct 25 16:35:02 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:02 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:35:02 user nova-compute[74048]:       <target dev="tap12a1be3f-29"/>
Oct 25 16:35:02 user nova-compute[74048]:     </interface>
Oct 25 16:35:02 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:35:02 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/console.log" append="off"/>
Oct 25 16:35:02 user nova-compute[74048]:     </serial>
Oct 25 16:35:02 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:35:02 user nova-compute[74048]:     <video>
Oct 25 16:35:02 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:02 user nova-compute[74048]:     </video>
Oct 25 16:35:02 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:35:02 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:35:02 user nova-compute[74048]:     </rng>
Oct 25 16:35:02 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:35:02 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:35:02 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:35:02 user nova-compute[74048]:     </memballoon>
Oct 25 16:35:02 user nova-compute[74048]:   </devices>
Oct 25 16:35:02 user nova-compute[74048]: </domain>
Oct 25 16:35:02 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1499400529',display_name='tempest-AttachVolumeNegativeTest-server-1499400529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1499400529',id=23,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu+Vb9olSog0NENb0JydaT8Ro8ry7jbASxsp12gjj4nVboFaid+URjU88lMGSDro9+QjF5QlFOwvVX82eOItn+tza4crMOJsbxkTWr47bBvYsty+AErLs22W32H+xvR/g==',key_name='tempest-keypair-114412920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-vb10w5yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=105119ce-b27f-41a7-b466-2f6b1ca03077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG os_vif [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aa7f541-de48-5597-8652-6cd5c8b8b284', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12a1be3f-29, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12a1be3f-29, col_values=(('qos', UUID('7ecb77af-bea2-4ba5-8a69-021bc7227f05')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12a1be3f-29, col_values=(('external_ids', {'iface-id': '12a1be3f-29dd-4dfc-8be7-77df08c2c23e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:ed:c2', 'vm-uuid': '105119ce-b27f-41a7-b466-2f6b1ca03077'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:02 user nova-compute[74048]: INFO os_vif [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29')
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No VIF found with MAC fa:16:3e:a4:ed:c2, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updated VIF entry in instance network info cache for port 12a1be3f-29dd-4dfc-8be7-77df08c2c23e. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updating instance_info_cache with network_info: [{"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b7b3608e-a148-48cf-b8d4-bd9d4fa9dcfa req-e9cf73ee-d98e-4a2c-b9db-e6462dfbbe02 service nova] Releasing lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG nova.compute.manager [req-c1d5254b-4614-4abc-8d10-19260660c8b3 req-9fafa799-aa8f-4a1a-9f82-c258e5f36c99 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c1d5254b-4614-4abc-8d10-19260660c8b3 req-9fafa799-aa8f-4a1a-9f82-c258e5f36c99 service nova] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c1d5254b-4614-4abc-8d10-19260660c8b3 req-9fafa799-aa8f-4a1a-9f82-c258e5f36c99 service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c1d5254b-4614-4abc-8d10-19260660c8b3 req-9fafa799-aa8f-4a1a-9f82-c258e5f36c99 service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:03 user nova-compute[74048]: DEBUG nova.compute.manager [req-c1d5254b-4614-4abc-8d10-19260660c8b3 req-9fafa799-aa8f-4a1a-9f82-c258e5f36c99 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] No waiting events found dispatching network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:03 user nova-compute[74048]: WARNING nova.compute.manager [req-c1d5254b-4614-4abc-8d10-19260660c8b3 req-9fafa799-aa8f-4a1a-9f82-c258e5f36c99 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received unexpected event network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e for instance with vm_state building and task_state spawning.
Oct 25 16:35:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:35:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Instance spawned successfully.
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-51c93c9d-5ef9-4f26-885a-2b7ca07cf4a2 req-3bad776c-8c55-4840-ab69-e53b434329fe service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-51c93c9d-5ef9-4f26-885a-2b7ca07cf4a2 req-3bad776c-8c55-4840-ab69-e53b434329fe service nova] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-51c93c9d-5ef9-4f26-885a-2b7ca07cf4a2 req-3bad776c-8c55-4840-ab69-e53b434329fe service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-51c93c9d-5ef9-4f26-885a-2b7ca07cf4a2 req-3bad776c-8c55-4840-ab69-e53b434329fe service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-51c93c9d-5ef9-4f26-885a-2b7ca07cf4a2 req-3bad776c-8c55-4840-ab69-e53b434329fe service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] No waiting events found dispatching network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:06 user nova-compute[74048]: WARNING nova.compute.manager [req-51c93c9d-5ef9-4f26-885a-2b7ca07cf4a2 req-3bad776c-8c55-4840-ab69-e53b434329fe service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received unexpected event network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e for instance with vm_state building and task_state spawning.
Oct 25 16:35:06 user nova-compute[74048]: INFO nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 25 16:35:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:35:06 user nova-compute[74048]: INFO nova.compute.manager [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Took 6.45 seconds to build instance.
Oct 25 16:35:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-46778ce6-4f3a-4aac-acc1-9db4b10f9d77 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.552s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing instance network info cache due to event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.network.neutron [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.objects.instance [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'flavor' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:14 user nova-compute[74048]: INFO nova.compute.manager [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Attaching volume a116c331-690a-4ad3-9f20-896a1256cab0 to /dev/vdb
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.network.neutron [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updated VIF entry in instance network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.network.neutron [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG os_brick.utils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-23a29009-f845-4de8-bb43-d1d32c06fe52 req-b3fc51f0-7aa1-42f1-a8a0-a786c52a1698 service nova] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2523f261-22d4-4d57-a340-feb9e5429273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f116159-5d8a-465e-b0f0-b4940ffc2bae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a9f99-3711-45dc-a330-5fcf45af2705]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7e3621-7972-47b7-a9ba-9fa835533850]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:14 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:35:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cdfb4a-d0a3-483a-b686-381ec55e8c03]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG os_brick.utils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:14 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating existing volume attachment record: 809a2d30-66d8-4dee-91dc-622da59eeaaf {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:35:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:35:17 user nova-compute[74048]: INFO nova.compute.claims [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Claim successful on node user
Oct 25 16:35:18 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 is timed out.
Oct 25 16:35:18 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Successfully detached device vdc from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the live domain config.
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfltHVgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:18 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[928e9226-9647-4bb7-906e-cdfb4e26cba5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:35:18 user nova-compute[74048]: No targets found.
Oct 25 16:35:18 user nova-compute[74048]: iSNS:
Oct 25 16:35:18 user nova-compute[74048]: No targets found.
Oct 25 16:35:18 user nova-compute[74048]: STATIC:
Oct 25 16:35:18 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36
Oct 25 16:35:18 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:35:18 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:35:18 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29
Oct 25 16:35:18 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:35:18 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:35:18 user nova-compute[74048]: FIRMWARE:
Oct 25 16:35:18 user nova-compute[74048]: No targets found.
Oct 25 16:35:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:35:18 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:35:18 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe7023-1127-43a5-88ae-b59c790f9c7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d686d-ae29-4cad-a8f9-057237146d4f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:18 user nova-compute[74048]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 (non-flash)
Oct 25 16:35:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:18 user nova-compute[74048]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 (non-flash)
Oct 25 16:35:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850374a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c0800-6264-4b73-bf05-ab3f9fbb8086]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e520d-f01c-44a0-bf05-64c62a0629ac]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf9c0c-66d2-4ab9-bbc9-84fc5a7760e9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada3bd8-f0aa-4f30-adbe-e3ced4d8e0c7]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.network.neutron [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0adf9d2-f3a7-41e4-8a43-05188f69ed73]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b975491-b68c-4797-808b-0fac7e45a32a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260]
Oct 25 16:35:18 user nova-compute[74048]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36, portal: 172.16.0.220,3260] successful.
Oct 25 16:35:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.policy [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50155e9b8e7d472882d4fcd6d84acfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242b649ca85c446d84b89b770c703c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd58b2e-bc00-45f5-815b-bb09f0d54e36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5424e03-861d-497f-ae76-10c375aef847]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] <== disconnect_volume: return (364ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:35:18 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Creating image(s)
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "bf6657dc68de9a6d36fb66751cf978cb1dba34ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "bf6657dc68de9a6d36fb66751cf978cb1dba34ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.part --force-share --output=json" returned: 0 in 0.243s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG nova.virt.images [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.part /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Successfully created port: 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'flavor' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.part /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.converted" returned: 0 in 0.402s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cef822d7-2b77-4ec1-bcf7-d93715d981d9 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.317s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "bf6657dc68de9a6d36fb66751cf978cb1dba34ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.405s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "bf6657dc68de9a6d36fb66751cf978cb1dba34ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "bf6657dc68de9a6d36fb66751cf978cb1dba34ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab,backing_fmt=raw /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab,backing_fmt=raw /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk 1073741824" returned: 0 in 0.058s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "bf6657dc68de9a6d36fb66751cf978cb1dba34ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.network.neutron [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Successfully updated port: 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing instance network info cache due to event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Cannot resize image /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Ensure instance console log exists: /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d7a8a61b-1deb-47d3-8f5b-f20172636f4a req-879d14e7-7a32-42df-880c-c93d8b8fb419 service nova] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.network.neutron [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:35:20 user nova-compute[74048]: DEBUG nova.network.neutron [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance network_info: |[{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Start _get_guest_xml network_info=[{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:35:15Z,direct_url=<?>,disk_format='qcow2',id=cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70,min_disk=0,min_ram=0,name='tempest-scenario-img--579468422',owner='242b649ca85c446d84b89b770c703c47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:35:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': 'cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:35:21 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:21 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:35:15Z,direct_url=<?>,disk_format='qcow2',id=cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70,min_disk=0,min_ram=0,name='tempest-scenario-img--579468422',owner='242b649ca85c446d84b89b770c703c47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:35:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1189844784',display_name='tempest-TestMinimumBasicScenario-server-1189844784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1189844784',id=24,image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWkaTm34IrrFgglBSk7gV/mazK3/QcVgVulSRYqYR4hz9wDbcdq1lllwiVe12fLxOWZ7RAIQTAv2Q1uscbN13y9VKwS0p/aJeGfPI6k23T/gHdXgomJF4gkR+6cXP8plA==',key_name='tempest-TestMinimumBasicScenario-91951899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-l76sfr2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:19Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=af48ff38-5eaa-4885-839d-bd8b8d6d4de4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'pci_devices' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:35:21 user nova-compute[74048]:   <uuid>af48ff38-5eaa-4885-839d-bd8b8d6d4de4</uuid>
Oct 25 16:35:21 user nova-compute[74048]:   <name>instance-00000018</name>
Oct 25 16:35:21 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:35:21 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:35:21 user nova-compute[74048]:   <metadata>
Oct 25 16:35:21 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:35:21 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:35:21 user nova-compute[74048]:       <nova:name>tempest-TestMinimumBasicScenario-server-1189844784</nova:name>
Oct 25 16:35:21 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:35:21</nova:creationTime>
Oct 25 16:35:21 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:35:21 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:35:21 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:35:21 user nova-compute[74048]:       <nova:owner>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:user uuid="50155e9b8e7d472882d4fcd6d84acfd1">tempest-TestMinimumBasicScenario-323418568-project-member</nova:user>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:project uuid="242b649ca85c446d84b89b770c703c47">tempest-TestMinimumBasicScenario-323418568</nova:project>
Oct 25 16:35:21 user nova-compute[74048]:       </nova:owner>
Oct 25 16:35:21 user nova-compute[74048]:       <nova:root type="image" uuid="cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70"/>
Oct 25 16:35:21 user nova-compute[74048]:       <nova:ports>
Oct 25 16:35:21 user nova-compute[74048]:         <nova:port uuid="963fe763-7fca-4fe8-bf4d-a252959c94fd">
Oct 25 16:35:21 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:35:21 user nova-compute[74048]:         </nova:port>
Oct 25 16:35:21 user nova-compute[74048]:       </nova:ports>
Oct 25 16:35:21 user nova-compute[74048]:     </nova:instance>
Oct 25 16:35:21 user nova-compute[74048]:   </metadata>
Oct 25 16:35:21 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:35:21 user nova-compute[74048]:     <system>
Oct 25 16:35:21 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:35:21 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:35:21 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:35:21 user nova-compute[74048]:       <entry name="serial">af48ff38-5eaa-4885-839d-bd8b8d6d4de4</entry>
Oct 25 16:35:21 user nova-compute[74048]:       <entry name="uuid">af48ff38-5eaa-4885-839d-bd8b8d6d4de4</entry>
Oct 25 16:35:21 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:35:21 user nova-compute[74048]:     </system>
Oct 25 16:35:21 user nova-compute[74048]:   </sysinfo>
Oct 25 16:35:21 user nova-compute[74048]:   <os>
Oct 25 16:35:21 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:35:21 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:35:21 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:35:21 user nova-compute[74048]:   </os>
Oct 25 16:35:21 user nova-compute[74048]:   <features>
Oct 25 16:35:21 user nova-compute[74048]:     <acpi/>
Oct 25 16:35:21 user nova-compute[74048]:     <apic/>
Oct 25 16:35:21 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:35:21 user nova-compute[74048]:   </features>
Oct 25 16:35:21 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:35:21 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:35:21 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:35:21 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:35:21 user nova-compute[74048]:   </clock>
Oct 25 16:35:21 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:35:21 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:35:21 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:35:21 user nova-compute[74048]:   </cpu>
Oct 25 16:35:21 user nova-compute[74048]:   <devices>
Oct 25 16:35:21 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:35:21 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:35:21 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk"/>
Oct 25 16:35:21 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:35:21 user nova-compute[74048]:     </disk>
Oct 25 16:35:21 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:35:21 user nova-compute[74048]:       <mac address="fa:16:3e:cc:19:90"/>
Oct 25 16:35:21 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:21 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:35:21 user nova-compute[74048]:       <target dev="tap963fe763-7f"/>
Oct 25 16:35:21 user nova-compute[74048]:     </interface>
Oct 25 16:35:21 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:35:21 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/console.log" append="off"/>
Oct 25 16:35:21 user nova-compute[74048]:     </serial>
Oct 25 16:35:21 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:35:21 user nova-compute[74048]:     <video>
Oct 25 16:35:21 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:21 user nova-compute[74048]:     </video>
Oct 25 16:35:21 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:35:21 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:35:21 user nova-compute[74048]:     </rng>
Oct 25 16:35:21 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:35:21 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:35:21 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:35:21 user nova-compute[74048]:     </memballoon>
Oct 25 16:35:21 user nova-compute[74048]:   </devices>
Oct 25 16:35:21 user nova-compute[74048]: </domain>
Oct 25 16:35:21 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1189844784',display_name='tempest-TestMinimumBasicScenario-server-1189844784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1189844784',id=24,image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWkaTm34IrrFgglBSk7gV/mazK3/QcVgVulSRYqYR4hz9wDbcdq1lllwiVe12fLxOWZ7RAIQTAv2Q1uscbN13y9VKwS0p/aJeGfPI6k23T/gHdXgomJF4gkR+6cXP8plA==',key_name='tempest-TestMinimumBasicScenario-91951899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-l76sfr2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:19Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=af48ff38-5eaa-4885-839d-bd8b8d6d4de4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG os_vif [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2565f84a-147e-5bf6-bbfd-2ed9b075aca7', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap963fe763-7f, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap963fe763-7f, col_values=(('qos', UUID('097b2501-d931-4b1b-9efb-a6cca88c6560')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap963fe763-7f, col_values=(('external_ids', {'iface-id': '963fe763-7fca-4fe8-bf4d-a252959c94fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:19:90', 'vm-uuid': 'af48ff38-5eaa-4885-839d-bd8b8d6d4de4'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:21 user nova-compute[74048]: INFO os_vif [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f')
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No VIF found with MAC fa:16:3e:cc:19:90, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-95fd4653-28fc-4fca-81b0-845dfccb3ad9 req-cc5000ad-058f-4a51-bb98-d902badbfae5 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-95fd4653-28fc-4fca-81b0-845dfccb3ad9 req-cc5000ad-058f-4a51-bb98-d902badbfae5 service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-95fd4653-28fc-4fca-81b0-845dfccb3ad9 req-cc5000ad-058f-4a51-bb98-d902badbfae5 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-95fd4653-28fc-4fca-81b0-845dfccb3ad9 req-cc5000ad-058f-4a51-bb98-d902badbfae5 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-95fd4653-28fc-4fca-81b0-845dfccb3ad9 req-cc5000ad-058f-4a51-bb98-d902badbfae5 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:23 user nova-compute[74048]: WARNING nova.compute.manager [req-95fd4653-28fc-4fca-81b0-845dfccb3ad9 req-cc5000ad-058f-4a51-bb98-d902badbfae5 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state building and task_state spawning.
Oct 25 16:35:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:25 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance spawned successfully.
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:25 user nova-compute[74048]: WARNING nova.compute.manager [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state building and task_state spawning.
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing instance network info cache due to event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.network.neutron [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:35:25 user nova-compute[74048]: INFO nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Took 6.88 seconds to spawn the instance on the hypervisor.
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:35:25 user nova-compute[74048]: INFO nova.compute.manager [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Took 7.74 seconds to build instance.
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9c7eba0e-a6b4-4236-b1de-f416d1813df8 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.841s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.network.neutron [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updated VIF entry in instance network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG nova.network.neutron [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dae14303-c65c-4c77-ac89-24fdffb8eb99 req-bac841e1-7ba8-4e85-91cb-15e74f6db829 service nova] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:26 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:35:26 user nova-compute[74048]: INFO nova.compute.manager [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] instance snapshotting
Oct 25 16:35:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Beginning live snapshot process
Oct 25 16:35:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1bi495sg/f1994eb4b76447d2a3fd10b23a98e8da.delta 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1bi495sg/f1994eb4b76447d2a3fd10b23a98e8da.delta 1073741824" returned: 0 in 0.052s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 16:35:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:35:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:35:28 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 16:35:29 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1bi495sg/f1994eb4b76447d2a3fd10b23a98e8da.delta /opt/stack/data/nova/instances/snapshots/tmp1bi495sg/f1994eb4b76447d2a3fd10b23a98e8da {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1bi495sg/f1994eb4b76447d2a3fd10b23a98e8da.delta /opt/stack/data/nova/instances/snapshots/tmp1bi495sg/f1994eb4b76447d2a3fd10b23a98e8da" returned: 0 in 0.495s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Snapshot extracted, beginning image upload
Oct 25 16:35:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "54b28e3c-f604-4d30-ac14-805da155813d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:35:29 user nova-compute[74048]: INFO nova.compute.claims [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Claim successful on node user
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:35:30 user nova-compute[74048]: DEBUG nova.policy [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a2170a4f3e541bea8147fbf3bc6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412dd65efab430eb361b71f048d3575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:35:30 user nova-compute[74048]: INFO nova.virt.block_device [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Booting with blank volume at /dev/vda
Oct 25 16:35:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Successfully created port: da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:35:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Successfully updated port: da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-changed-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Refreshing instance network info cache due to event network-changed-da4f4f96-f7ae-49b9-988f-823a9abebd58. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] Acquiring lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance network_info: |[{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] Acquired lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Refreshing network info cache for port da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:35:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Snapshot image upload complete
Oct 25 16:35:32 user nova-compute[74048]: INFO nova.compute.manager [None req-e4b586e6-f7fc-4306-bcf5-4f1616595985 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Took 5.99 seconds to snapshot the instance on the hypervisor.
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updated VIF entry in instance network info cache for port da4f4f96-f7ae-49b9-988f-823a9abebd58. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:35:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f64cfaa-1887-48c9-a86b-da02e943e286 req-05d00515-5030-455b-af9f-4577c3914edd service nova] Releasing lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNzMlRdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:35:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:35:33 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[968e1ea9-8409-413f-a314-635584dacb8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:35:33 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff542e-3659-400e-8e1c-dc363bca6bce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0] added
Oct 25 16:35:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe5ae0-0024-457a-a3a7-dba1495b4a13]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[81770253-80aa-4116-980a-90d2290810a8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNzMlRdC {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNzMlRdC" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8156bf0-f4fa-4647-9a58-ecb50a809dd6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNzMlRdC'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23e083-01f9-428c-8b5a-b3cf77446e9c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0838530c-c09a-4236-85ea-de6205d1ff78]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:35:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d698f4-1beb-48da-93c4-0e336f83e862]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260]
Oct 25 16:35:34 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260] successful.
Oct 25 16:35:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e4ad9c-7eda-4d0e-9839-c033dd1f1c0a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[751678e4-39fa-4855-95a8-114cf8eefdc1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:34 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:35:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:34 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:35:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86dbb07-7f48-49e7-b252-34212288451e]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:35:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNzMlRdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23431643366396161', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431643366396161', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG nova.objects.instance [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'flavor' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:35:35 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:35:35 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:35:35 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:35:35 user nova-compute[74048]:   <serial>a116c331-690a-4ad3-9f20-896a1256cab0</serial>
Oct 25 16:35:35 user nova-compute[74048]: </disk>
Oct 25 16:35:35 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:32:60:1b, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0ce6dad4-04f6-41ae-bea3-2a6630f878f2 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.067s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:35 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG os_brick.utils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc4f818-a41a-4d00-aed9-240ba40c0132]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08227b4a-7cac-4d6d-a61c-310355d5974e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f737bb8a-8b23-47e3-8092-c8f240393c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca10e9a-0910-40a0-acee-72448f69418c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:36 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3241d9fa-0347-4d38-8a8f-92bf8bb8c819]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG os_brick.utils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating existing volume attachment record: 95bc3c11-6050-4809-8427-c9a4ab6fa8bc {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:36 user nova-compute[74048]: INFO nova.compute.manager [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Rescuing
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:36 user nova-compute[74048]: DEBUG nova.network.neutron [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-f826cccc-2a3b-4801-b22f-1cc18eb12a5f req-c299b9a1-1326-4f24-9170-c368b66f2527 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f826cccc-2a3b-4801-b22f-1cc18eb12a5f req-c299b9a1-1326-4f24-9170-c368b66f2527 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f826cccc-2a3b-4801-b22f-1cc18eb12a5f req-c299b9a1-1326-4f24-9170-c368b66f2527 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f826cccc-2a3b-4801-b22f-1cc18eb12a5f req-c299b9a1-1326-4f24-9170-c368b66f2527 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-f826cccc-2a3b-4801-b22f-1cc18eb12a5f req-c299b9a1-1326-4f24-9170-c368b66f2527 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:37 user nova-compute[74048]: WARNING nova.compute.manager [req-f826cccc-2a3b-4801-b22f-1cc18eb12a5f req-c299b9a1-1326-4f24-9170-c368b66f2527 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state active and task_state rescuing.
Oct 25 16:35:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance destroyed successfully.
Oct 25 16:35:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Attempting rescue
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74048) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:35:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Creating image(s)
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue" returned: 0 in 0.056s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'migration_context' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.base [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<c7c52922-5f40-4d8b-937d-9cec99edd27f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Start _get_guest_xml network_info=[{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:32:60:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'resources' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.base [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<c7c52922-5f40-4d8b-937d-9cec99edd27f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'numa_topology' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.base [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<c7c52922-5f40-4d8b-937d-9cec99edd27f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:35:38 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:38 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.base [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<c7c52922-5f40-4d8b-937d-9cec99edd27f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-673488562',display_name='tempest-ServerRescueNegativeTestJSON-server-673488562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-673488562',id=21,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmNeLNw9htCIEO231GPElA6ydc2Uc3wg0whqBcPQYXqnSe3ubg6fZPtmXkqaWAcNN+Xs134+oixSppb8lj9PqbxooDRz2hA85UXAM6fxBcGkqboSE8AbcT3vJE2dYMXA==',key_name='tempest-keypair-1695340235',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:33:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-qtkf4aw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=c7c52922-5f40-4d8b-937d-9cec99edd27f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:32:60:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "vif_mac": "fa:16:3e:32:60:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'pci_devices' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.objects.base [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Object Instance<c7c52922-5f40-4d8b-937d-9cec99edd27f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:35:38 user nova-compute[74048]:   <uuid>c7c52922-5f40-4d8b-937d-9cec99edd27f</uuid>
Oct 25 16:35:38 user nova-compute[74048]:   <name>instance-00000015</name>
Oct 25 16:35:38 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:35:38 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:35:38 user nova-compute[74048]:   <metadata>
Oct 25 16:35:38 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:35:38 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:35:38 user nova-compute[74048]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-673488562</nova:name>
Oct 25 16:35:38 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:35:38</nova:creationTime>
Oct 25 16:35:38 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:35:38 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:35:38 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:35:38 user nova-compute[74048]:       <nova:owner>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:user uuid="94ff1b26939b49ba88fe0105bec65fc2">tempest-ServerRescueNegativeTestJSON-1121503960-project-member</nova:user>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:project uuid="931f649d6b844bbdaec9f1b97ab1112c">tempest-ServerRescueNegativeTestJSON-1121503960</nova:project>
Oct 25 16:35:38 user nova-compute[74048]:       </nova:owner>
Oct 25 16:35:38 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:35:38 user nova-compute[74048]:       <nova:ports>
Oct 25 16:35:38 user nova-compute[74048]:         <nova:port uuid="eca5c7af-25bc-4905-8a8d-927cf755084f">
Oct 25 16:35:38 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:35:38 user nova-compute[74048]:         </nova:port>
Oct 25 16:35:38 user nova-compute[74048]:       </nova:ports>
Oct 25 16:35:38 user nova-compute[74048]:     </nova:instance>
Oct 25 16:35:38 user nova-compute[74048]:   </metadata>
Oct 25 16:35:38 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:35:38 user nova-compute[74048]:     <system>
Oct 25 16:35:38 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:35:38 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:35:38 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:35:38 user nova-compute[74048]:       <entry name="serial">c7c52922-5f40-4d8b-937d-9cec99edd27f</entry>
Oct 25 16:35:38 user nova-compute[74048]:       <entry name="uuid">c7c52922-5f40-4d8b-937d-9cec99edd27f</entry>
Oct 25 16:35:38 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:35:38 user nova-compute[74048]:     </system>
Oct 25 16:35:38 user nova-compute[74048]:   </sysinfo>
Oct 25 16:35:38 user nova-compute[74048]:   <os>
Oct 25 16:35:38 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:35:38 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:35:38 user nova-compute[74048]:   </os>
Oct 25 16:35:38 user nova-compute[74048]:   <features>
Oct 25 16:35:38 user nova-compute[74048]:     <acpi/>
Oct 25 16:35:38 user nova-compute[74048]:     <apic/>
Oct 25 16:35:38 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:35:38 user nova-compute[74048]:   </features>
Oct 25 16:35:38 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:35:38 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:35:38 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:35:38 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:35:38 user nova-compute[74048]:   </clock>
Oct 25 16:35:38 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:35:38 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:35:38 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:35:38 user nova-compute[74048]:   </cpu>
Oct 25 16:35:38 user nova-compute[74048]:   <devices>
Oct 25 16:35:38 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:35:38 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:35:38 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue"/>
Oct 25 16:35:38 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:35:38 user nova-compute[74048]:     </disk>
Oct 25 16:35:38 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:35:38 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:35:38 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk"/>
Oct 25 16:35:38 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:35:38 user nova-compute[74048]:     </disk>
Oct 25 16:35:38 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:35:38 user nova-compute[74048]:       <mac address="fa:16:3e:32:60:1b"/>
Oct 25 16:35:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:38 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:35:38 user nova-compute[74048]:       <target dev="tapeca5c7af-25"/>
Oct 25 16:35:38 user nova-compute[74048]:     </interface>
Oct 25 16:35:38 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:35:38 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/console.log" append="off"/>
Oct 25 16:35:38 user nova-compute[74048]:     </serial>
Oct 25 16:35:38 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:35:38 user nova-compute[74048]:     <video>
Oct 25 16:35:38 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:38 user nova-compute[74048]:     </video>
Oct 25 16:35:38 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:35:38 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:35:38 user nova-compute[74048]:     </rng>
Oct 25 16:35:38 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:35:38 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:35:38 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:35:38 user nova-compute[74048]:     </memballoon>
Oct 25 16:35:38 user nova-compute[74048]:   </devices>
Oct 25 16:35:38 user nova-compute[74048]: </domain>
Oct 25 16:35:38 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:35:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance destroyed successfully.
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] No VIF found with MAC fa:16:3e:32:60:1b, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:35:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-34c10f55-32e9-4d5e-984c-be28b23d5233 req-792cd4f1-137b-4523-8603-d4081b362f1b service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-34c10f55-32e9-4d5e-984c-be28b23d5233 req-792cd4f1-137b-4523-8603-d4081b362f1b service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-34c10f55-32e9-4d5e-984c-be28b23d5233 req-792cd4f1-137b-4523-8603-d4081b362f1b service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-34c10f55-32e9-4d5e-984c-be28b23d5233 req-792cd4f1-137b-4523-8603-d4081b362f1b service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-34c10f55-32e9-4d5e-984c-be28b23d5233 req-792cd4f1-137b-4523-8603-d4081b362f1b service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:39 user nova-compute[74048]: WARNING nova.compute.manager [req-34c10f55-32e9-4d5e-984c-be28b23d5233 req-792cd4f1-137b-4523-8603-d4081b362f1b service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state active and task_state rescuing.
Oct 25 16:35:39 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:35:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:41 user nova-compute[74048]: WARNING nova.compute.manager [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state active and task_state rescuing.
Oct 25 16:35:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:41 user nova-compute[74048]: WARNING nova.compute.manager [req-87b69d4e-a42f-4279-8788-4ac83091c147 req-8e315d49-f9d1-428d-b37e-6cb3fad13559 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state active and task_state rescuing.
Oct 25 16:35:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-95302fb3-ead5-49a8-89fe-a9a90428409c tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:35:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:35:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:45 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:48 user nova-compute[74048]: INFO nova.compute.manager [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Detaching volume c9dce109-40f9-434a-986c-d460508f3f29
Oct 25 16:35:48 user nova-compute[74048]: INFO nova.virt.block_device [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Attempting to driver detach volume c9dce109-40f9-434a-986c-d460508f3f29 from mountpoint /dev/vdb
Oct 25 16:35:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Attempting to detach device vdb from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:35:48 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:35:48 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:35:48 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:35:48 user nova-compute[74048]:   <serial>c9dce109-40f9-434a-986c-d460508f3f29</serial>
Oct 25 16:35:48 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:35:48 user nova-compute[74048]: </disk>
Oct 25 16:35:48 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:48 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Successfully detached device vdb from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the persistent domain config.
Oct 25 16:35:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:35:48 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:35:48 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:35:48 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:35:48 user nova-compute[74048]:   <serial>c9dce109-40f9-434a-986c-d460508f3f29</serial>
Oct 25 16:35:48 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:35:48 user nova-compute[74048]: </disk>
Oct 25 16:35:48 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:50 user nova-compute[74048]: INFO nova.compute.manager [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Unshelving
Oct 25 16:35:50 user nova-compute[74048]: INFO nova.virt.block_device [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Booting with volume da74e58d-992d-40ad-9773-00eb07783c44 at /dev/vda
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG os_brick.utils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c05d4fa-d086-43f2-8ebb-850f80e12599]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b44077-3fa2-4b2a-9385-30d82d80aef5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ccd069-7c40-4de6-8d90-214e62f6af78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c6018-61e8-4b37-aa88-f84e9f5d61e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:50 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f4970b-f0a0-40d5-9865-8337407aeed7]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG os_brick.utils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating existing volume attachment record: d606148e-412e-4026-88d0-f7a657c24a3e {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7638MB free_disk=25.278846740722656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 105119ce-b27f-41a7-b466-2f6b1ca03077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 95c95f8e-996a-4ce3-a32d-b1fe86311740 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:35:51 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:35:52 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:35:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:52 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:35:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:35:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.781s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:35:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:35:54 user nova-compute[74048]: INFO nova.compute.claims [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Claim successful on node user
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:35:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.policy [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '923326e5c82043a59dc710681f5b75d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2991a6a83b4d420fae14308026933e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:35:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Creating image(s)
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk 1073741824" returned: 0 in 0.057s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Successfully created port: b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Cannot resize image /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Ensure instance console log exists: /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Successfully updated port: b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-changed-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Refreshing instance network info cache due to event network-changed-b225761b-69af-459c-ad4e-8901ba049969. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:35:56 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Creating image(s)
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Ensure instance console log exists: /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Start _get_guest_xml network_info=[{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '95bc3c11-6050-4809-8427-c9a4ab6fa8bc', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54b28e3c-f604-4d30-ac14-805da155813d', 'attached_at': '', 'detached_at': '', 'volume_id': '55a0cafc-b396-4943-8baa-b238e9958208', 'serial': '55a0cafc-b396-4943-8baa-b238e9958208'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:35:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:35:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:35:56 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58872cc-778e-41fa-8b0a-3906817c1d3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:35:56 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19307b08-0db8-47bc-8e50-876c9c87c50b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208] added
Oct 25 16:35:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdfe562-4680-4577-a3fc-814f4732b573]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d6631-6b59-436d-90f2-6abb24f94d71]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LanFJviy {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LanFJviy" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6668b215-bbba-4d63-8529-60ee28a2d5a2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LanFJviy'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[91268d05-2081-4583-9f62-b89f6c7c03b8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed4137d-a047-49b2-bae7-453d30cc9b12]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd7231a-4b7e-4dfa-849d-362f24691cd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260]
Oct 25 16:35:56 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260] successful.
Oct 25 16:35:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a31ff-7eed-40bf-ab37-a6be3e379cfc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[03779e61-db9d-4d2e-bc72-5f13709f199f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:35:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance network_info: |[{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Refreshing network info cache for port b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start _get_guest_xml network_info=[{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce315226-a255-4197-8e63-8a40bd22c384]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:35:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:35:56 user nova-compute[74048]:   <uuid>7f739b1f-87a3-4521-bf08-c3b395fb0d44</uuid>
Oct 25 16:35:56 user nova-compute[74048]:   <name>instance-0000001a</name>
Oct 25 16:35:56 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:35:56 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:35:56 user nova-compute[74048]:   <metadata>
Oct 25 16:35:56 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:35:56 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:35:56 user nova-compute[74048]:       <nova:name>tempest-ServerActionsTestOtherB-server-191961762</nova:name>
Oct 25 16:35:56 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:35:56</nova:creationTime>
Oct 25 16:35:56 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:35:56 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:35:56 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:35:56 user nova-compute[74048]:       <nova:owner>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:user uuid="923326e5c82043a59dc710681f5b75d8">tempest-ServerActionsTestOtherB-2012243518-project-member</nova:user>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:project uuid="2991a6a83b4d420fae14308026933e56">tempest-ServerActionsTestOtherB-2012243518</nova:project>
Oct 25 16:35:56 user nova-compute[74048]:       </nova:owner>
Oct 25 16:35:56 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:35:56 user nova-compute[74048]:       <nova:ports>
Oct 25 16:35:56 user nova-compute[74048]:         <nova:port uuid="b225761b-69af-459c-ad4e-8901ba049969">
Oct 25 16:35:56 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:35:56 user nova-compute[74048]:         </nova:port>
Oct 25 16:35:56 user nova-compute[74048]:       </nova:ports>
Oct 25 16:35:56 user nova-compute[74048]:     </nova:instance>
Oct 25 16:35:56 user nova-compute[74048]:   </metadata>
Oct 25 16:35:56 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:35:56 user nova-compute[74048]:     <system>
Oct 25 16:35:56 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:35:56 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:35:56 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:35:56 user nova-compute[74048]:       <entry name="serial">7f739b1f-87a3-4521-bf08-c3b395fb0d44</entry>
Oct 25 16:35:56 user nova-compute[74048]:       <entry name="uuid">7f739b1f-87a3-4521-bf08-c3b395fb0d44</entry>
Oct 25 16:35:56 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:35:56 user nova-compute[74048]:     </system>
Oct 25 16:35:56 user nova-compute[74048]:   </sysinfo>
Oct 25 16:35:56 user nova-compute[74048]:   <os>
Oct 25 16:35:56 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:35:56 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:35:56 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:35:56 user nova-compute[74048]:   </os>
Oct 25 16:35:56 user nova-compute[74048]:   <features>
Oct 25 16:35:56 user nova-compute[74048]:     <acpi/>
Oct 25 16:35:56 user nova-compute[74048]:     <apic/>
Oct 25 16:35:56 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:35:56 user nova-compute[74048]:   </features>
Oct 25 16:35:56 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:35:56 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:35:56 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:35:56 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:35:56 user nova-compute[74048]:   </clock>
Oct 25 16:35:56 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:35:56 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:35:56 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:35:56 user nova-compute[74048]:   </cpu>
Oct 25 16:35:56 user nova-compute[74048]:   <devices>
Oct 25 16:35:56 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:35:56 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:35:56 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk"/>
Oct 25 16:35:56 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:35:56 user nova-compute[74048]:     </disk>
Oct 25 16:35:56 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:35:56 user nova-compute[74048]:       <mac address="fa:16:3e:c1:c0:a3"/>
Oct 25 16:35:56 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:56 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:35:56 user nova-compute[74048]:       <target dev="tapb225761b-69"/>
Oct 25 16:35:56 user nova-compute[74048]:     </interface>
Oct 25 16:35:56 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:35:56 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/console.log" append="off"/>
Oct 25 16:35:56 user nova-compute[74048]:     </serial>
Oct 25 16:35:56 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:35:56 user nova-compute[74048]:     <video>
Oct 25 16:35:56 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:56 user nova-compute[74048]:     </video>
Oct 25 16:35:56 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:35:56 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:35:56 user nova-compute[74048]:     </rng>
Oct 25 16:35:56 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:35:56 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:35:56 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:35:56 user nova-compute[74048]:     </memballoon>
Oct 25 16:35:56 user nova-compute[74048]:   </devices>
Oct 25 16:35:56 user nova-compute[74048]: </domain>
Oct 25 16:35:56 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG os_vif [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be27a5a-8134-5132-9a59-00c3b78764f4', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb225761b-69, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb225761b-69, col_values=(('qos', UUID('4bdb51bc-a44e-499c-be0f-b57b53397fbd')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb225761b-69, col_values=(('external_ids', {'iface-id': 'b225761b-69af-459c-ad4e-8901ba049969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c0:a3', 'vm-uuid': '7f739b1f-87a3-4521-bf08-c3b395fb0d44'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: INFO os_vif [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69')
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No VIF found with MAC fa:16:3e:c1:c0:a3, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updated VIF entry in instance network info cache for port b225761b-69af-459c-ad4e-8901ba049969. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ff334a8f-5da7-41df-965d-7f1f4c77012e req-b3d65957-ecde-494f-af2b-0463ad9ab52d service nova] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26661643533623833', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661643533623833', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1501783072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1501783072',id=25,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-lqxy30xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:30Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=54b28e3c-f604-4d30-ac14-805da155813d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'pci_devices' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:35:57 user nova-compute[74048]:   <uuid>54b28e3c-f604-4d30-ac14-805da155813d</uuid>
Oct 25 16:35:57 user nova-compute[74048]:   <name>instance-00000019</name>
Oct 25 16:35:57 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:35:57 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:35:57 user nova-compute[74048]:   <metadata>
Oct 25 16:35:57 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:35:57 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:35:57 user nova-compute[74048]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1501783072</nova:name>
Oct 25 16:35:57 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:35:56</nova:creationTime>
Oct 25 16:35:57 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:35:57 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:35:57 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:35:57 user nova-compute[74048]:       <nova:owner>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:user uuid="6a2170a4f3e541bea8147fbf3bc6b746">tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member</nova:user>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:project uuid="4412dd65efab430eb361b71f048d3575">tempest-ServerBootFromVolumeStableRescueTest-399579320</nova:project>
Oct 25 16:35:57 user nova-compute[74048]:       </nova:owner>
Oct 25 16:35:57 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:35:57 user nova-compute[74048]:       <nova:ports>
Oct 25 16:35:57 user nova-compute[74048]:         <nova:port uuid="da4f4f96-f7ae-49b9-988f-823a9abebd58">
Oct 25 16:35:57 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:35:57 user nova-compute[74048]:         </nova:port>
Oct 25 16:35:57 user nova-compute[74048]:       </nova:ports>
Oct 25 16:35:57 user nova-compute[74048]:     </nova:instance>
Oct 25 16:35:57 user nova-compute[74048]:   </metadata>
Oct 25 16:35:57 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:35:57 user nova-compute[74048]:     <system>
Oct 25 16:35:57 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:35:57 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:35:57 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:35:57 user nova-compute[74048]:       <entry name="serial">54b28e3c-f604-4d30-ac14-805da155813d</entry>
Oct 25 16:35:57 user nova-compute[74048]:       <entry name="uuid">54b28e3c-f604-4d30-ac14-805da155813d</entry>
Oct 25 16:35:57 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:35:57 user nova-compute[74048]:     </system>
Oct 25 16:35:57 user nova-compute[74048]:   </sysinfo>
Oct 25 16:35:57 user nova-compute[74048]:   <os>
Oct 25 16:35:57 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:35:57 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:35:57 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:35:57 user nova-compute[74048]:   </os>
Oct 25 16:35:57 user nova-compute[74048]:   <features>
Oct 25 16:35:57 user nova-compute[74048]:     <acpi/>
Oct 25 16:35:57 user nova-compute[74048]:     <apic/>
Oct 25 16:35:57 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:35:57 user nova-compute[74048]:   </features>
Oct 25 16:35:57 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:35:57 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:35:57 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:35:57 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:35:57 user nova-compute[74048]:   </clock>
Oct 25 16:35:57 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:35:57 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:35:57 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:35:57 user nova-compute[74048]:   </cpu>
Oct 25 16:35:57 user nova-compute[74048]:   <devices>
Oct 25 16:35:57 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:35:57 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:35:57 user nova-compute[74048]:       <source dev="/dev/sdd"/>
Oct 25 16:35:57 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:35:57 user nova-compute[74048]:       <serial>55a0cafc-b396-4943-8baa-b238e9958208</serial>
Oct 25 16:35:57 user nova-compute[74048]:     </disk>
Oct 25 16:35:57 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:35:57 user nova-compute[74048]:       <mac address="fa:16:3e:ed:63:3e"/>
Oct 25 16:35:57 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:57 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:35:57 user nova-compute[74048]:       <target dev="tapda4f4f96-f7"/>
Oct 25 16:35:57 user nova-compute[74048]:     </interface>
Oct 25 16:35:57 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:35:57 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/console.log" append="off"/>
Oct 25 16:35:57 user nova-compute[74048]:     </serial>
Oct 25 16:35:57 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:35:57 user nova-compute[74048]:     <video>
Oct 25 16:35:57 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:35:57 user nova-compute[74048]:     </video>
Oct 25 16:35:57 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:35:57 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:35:57 user nova-compute[74048]:     </rng>
Oct 25 16:35:57 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:35:57 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:35:57 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:35:57 user nova-compute[74048]:     </memballoon>
Oct 25 16:35:57 user nova-compute[74048]:   </devices>
Oct 25 16:35:57 user nova-compute[74048]: </domain>
Oct 25 16:35:57 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1501783072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1501783072',id=25,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-lqxy30xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:30Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=54b28e3c-f604-4d30-ac14-805da155813d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG os_vif [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf43ca57-87b9-5ce4-8a27-50a7548fbd4b', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda4f4f96-f7, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda4f4f96-f7, col_values=(('qos', UUID('453f5280-6b80-445c-b179-149366d43ce3')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda4f4f96-f7, col_values=(('external_ids', {'iface-id': 'da4f4f96-f7ae-49b9-988f-823a9abebd58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:63:3e', 'vm-uuid': '54b28e3c-f604-4d30-ac14-805da155813d'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:58 user nova-compute[74048]: INFO os_vif [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7')
Oct 25 16:35:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No VIF found with MAC fa:16:3e:ed:63:3e, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-302d7b47-adac-4966-9a8b-8dbfdaf83416 req-9b41e900-23af-4fce-add4-800e56c4e73f service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-302d7b47-adac-4966-9a8b-8dbfdaf83416 req-9b41e900-23af-4fce-add4-800e56c4e73f service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-302d7b47-adac-4966-9a8b-8dbfdaf83416 req-9b41e900-23af-4fce-add4-800e56c4e73f service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-302d7b47-adac-4966-9a8b-8dbfdaf83416 req-9b41e900-23af-4fce-add4-800e56c4e73f service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:35:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-302d7b47-adac-4966-9a8b-8dbfdaf83416 req-9b41e900-23af-4fce-add4-800e56c4e73f service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:35:58 user nova-compute[74048]: WARNING nova.compute.manager [req-302d7b47-adac-4966-9a8b-8dbfdaf83416 req-9b41e900-23af-4fce-add4-800e56c4e73f service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state building and task_state spawning.
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:35:59 user nova-compute[74048]: INFO nova.compute.manager [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Unshelving
Oct 25 16:35:59 user nova-compute[74048]: INFO nova.virt.block_device [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Booting with volume 7a32bf78-dc59-4c78-ab85-776a570d7e6f at /dev/vdc
Oct 25 16:35:59 user nova-compute[74048]: DEBUG os_brick.utils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[122faeaa-92ae-430a-9cb5-bcea3e9afa98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa005290-be07-4efe-8486-1ed9b2800307]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09a3265-3679-46fb-a3dd-56a9348fec9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102997a-4bfb-4787-8f22-468d58800fe9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:35:59 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:35:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca39fcf-eed8-47ab-a638-d0769e8ad46c]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG os_brick.utils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating existing volume attachment record: dfd3029f-9a20-465a-8041-04e51e54b570 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:35:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-a5bb87fe-4fb0-4549-bab1-b0f80ca42fbf req-c5a1a272-4b84-4976-b29d-b598ee71f8d3 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a5bb87fe-4fb0-4549-bab1-b0f80ca42fbf req-c5a1a272-4b84-4976-b29d-b598ee71f8d3 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a5bb87fe-4fb0-4549-bab1-b0f80ca42fbf req-c5a1a272-4b84-4976-b29d-b598ee71f8d3 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a5bb87fe-4fb0-4549-bab1-b0f80ca42fbf req-c5a1a272-4b84-4976-b29d-b598ee71f8d3 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-a5bb87fe-4fb0-4549-bab1-b0f80ca42fbf req-c5a1a272-4b84-4976-b29d-b598ee71f8d3 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:00 user nova-compute[74048]: WARNING nova.compute.manager [req-a5bb87fe-4fb0-4549-bab1-b0f80ca42fbf req-c5a1a272-4b84-4976-b29d-b598ee71f8d3 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state building and task_state spawning.
Oct 25 16:36:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-c5a899b6-2b5d-44cb-a047-816252d0be3e req-9a944a61-22a0-45aa-a952-946fddc91d3b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c5a899b6-2b5d-44cb-a047-816252d0be3e req-9a944a61-22a0-45aa-a952-946fddc91d3b service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c5a899b6-2b5d-44cb-a047-816252d0be3e req-9a944a61-22a0-45aa-a952-946fddc91d3b service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c5a899b6-2b5d-44cb-a047-816252d0be3e req-9a944a61-22a0-45aa-a952-946fddc91d3b service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-c5a899b6-2b5d-44cb-a047-816252d0be3e req-9a944a61-22a0-45aa-a952-946fddc91d3b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:00 user nova-compute[74048]: WARNING nova.compute.manager [req-c5a899b6-2b5d-44cb-a047-816252d0be3e req-9a944a61-22a0-45aa-a952-946fddc91d3b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state building and task_state spawning.
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:36:01 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance spawned successfully.
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:01 user nova-compute[74048]: INFO nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 25 16:36:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:36:01 user nova-compute[74048]: INFO nova.compute.manager [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Took 7.24 seconds to build instance.
Oct 25 16:36:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e74944cc-546c-444b-ab33-605245592689 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.339s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:36:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance spawned successfully.
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:36:02 user nova-compute[74048]: INFO nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-ba32e0b9-c887-42c0-9d84-d37e9ef18714 req-466163e3-0bf8-4337-96e2-c67447a15230 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ba32e0b9-c887-42c0-9d84-d37e9ef18714 req-466163e3-0bf8-4337-96e2-c67447a15230 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ba32e0b9-c887-42c0-9d84-d37e9ef18714 req-466163e3-0bf8-4337-96e2-c67447a15230 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ba32e0b9-c887-42c0-9d84-d37e9ef18714 req-466163e3-0bf8-4337-96e2-c67447a15230 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-ba32e0b9-c887-42c0-9d84-d37e9ef18714 req-466163e3-0bf8-4337-96e2-c67447a15230 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:02 user nova-compute[74048]: WARNING nova.compute.manager [req-ba32e0b9-c887-42c0-9d84-d37e9ef18714 req-466163e3-0bf8-4337-96e2-c67447a15230 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state building and task_state spawning.
Oct 25 16:36:02 user nova-compute[74048]: INFO nova.compute.manager [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Took 32.64 seconds to build instance.
Oct 25 16:36:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3e6f32a-c1b3-4dff-8f7a-64ba655e6595 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "54b28e3c-f604-4d30-ac14-805da155813d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.805s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:08 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 is timed out.
Oct 25 16:36:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Successfully detached device vdb from instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1 from the live domain config.
Oct 25 16:36:08 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uAOkrKog', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:36:08 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:36:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fca74b-795c-4e4b-a950-8d45ef35d6c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:36:08 user nova-compute[74048]: No targets found.
Oct 25 16:36:08 user nova-compute[74048]: iSNS:
Oct 25 16:36:08 user nova-compute[74048]: No targets found.
Oct 25 16:36:08 user nova-compute[74048]: STATIC:
Oct 25 16:36:08 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:36:08 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:36:08 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:36:08 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:36:08 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:36:08 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:36:08 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29
Oct 25 16:36:08 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:36:08 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:36:08 user nova-compute[74048]: FIRMWARE:
Oct 25 16:36:08 user nova-compute[74048]: No targets found.
Oct 25 16:36:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:36:08 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:36:08 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde3040f-bded-44b0-a265-f527904dfd6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[239fd361-ded2-4c1a-be3a-498cf755925f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:36:09 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:09 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 (non-flash)
Oct 25 16:36:09 user nova-compute[74048]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:09 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840548310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3f1d1-1e55-4eb0-b7fd-ad162f40d74a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b890e05-f986-41e4-90cc-bc3958a33600]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43887131-94e4-4bd8-800b-a3c9f754e90b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[787772b2-4105-4d1a-9317-55d8a8ff72c9]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42c2cbb-6859-4cea-8019-5a4fb7fb9264]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a903a-bda8-491a-8be6-31c4b8b1893f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260]
Oct 25 16:36:09 user nova-compute[74048]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29, portal: 172.16.0.220,3260] successful.
Oct 25 16:36:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9dce109-40f9-434a-986c-d460508f3f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f806a989-d421-477f-8e82-67aefa57b568]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] <== disconnect_volume: return (331ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG nova.objects.instance [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'pci_requests' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG nova.objects.instance [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'numa_topology' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:09 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:36:09 user nova-compute[74048]: INFO nova.compute.claims [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Claim successful on node user
Oct 25 16:36:10 user nova-compute[74048]: DEBUG nova.objects.instance [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'flavor' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-84abf737-2ac9-491c-88ed-610fe45a16c6 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:36:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:36:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:10 user nova-compute[74048]: INFO nova.network.neutron [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating port c39060db-5027-4548-993a-9975c447cfb7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 16:36:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-changed-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing instance network info cache due to event network-changed-c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:36:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Creating image(s)
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Ensure instance console log exists: /opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Start _get_guest_xml network_info=[{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'd606148e-412e-4026-88d0-f7a657c24a3e', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95c95f8e-996a-4ce3-a32d-b1fe86311740', 'attached_at': '', 'detached_at': '', 'volume_id': 'da74e58d-992d-40ad-9773-00eb07783c44', 'serial': 'da74e58d-992d-40ad-9773-00eb07783c44'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing network info cache for port c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:36:11 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:36:11 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.objects.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Object Instance<95c95f8e-996a-4ce3-a32d-b1fe86311740> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:36:11 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:36:11 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:36:11 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4be828-acd1-4ea2-9a60-179dd4b303a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:36:11 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a664c6-5e81-42ac-8353-14c748b6fadb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44] added
Oct 25 16:36:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc783fc-c9cf-4249-8ea4-c95e63af8790]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0c3a39-6aca-4f23-8430-6780b2c1059a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgPBLTxN {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgPBLTxN" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60c74a7-ad84-44fb-a4af-1c33fb3d282e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgPBLTxN'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[55444762-dee8-446c-86c8-353b400b39a1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a470fd15-d123-4303-bb17-7474b1462e2d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ff5bf-256b-4693-8569-c12a1272361f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]
Oct 25 16:36:11 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.
Oct 25 16:36:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5937ab5-a91c-4c3b-8a00-49565af7d614]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ed991-7f8b-4ee2-a21f-d70d13924e32]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:36:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb57e92-a49b-4d14-91e0-d73d83d70e47]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updated VIF entry in instance network info cache for port c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:36:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4fabe063-d671-4374-a8fa-ff662dcb626e req-0c5c46ef-703b-4235-a60d-9d918a4af0f7 service nova] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23963613961336630', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613961336630', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-343536256',display_name='tempest-TestShelveInstance-server-343536256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-343536256',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2011198275',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='00f7ca267a294268b08d2452f427f8b2',ramdisk_id='',reservation_id='r-bcsns6bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-686947210',owner_user_name='tempest-TestShelveInstance-686947210-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:35:50Z,user_data=None,user_id='48ec0ba2f8824a2bacee58bf893a77d0',uuid=95c95f8e-996a-4ce3-a32d-b1fe86311740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converting VIF {"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.objects.instance [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'pci_devices' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.objects.base [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Object Instance<95c95f8e-996a-4ce3-a32d-b1fe86311740> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:36:12 user nova-compute[74048]:   <uuid>95c95f8e-996a-4ce3-a32d-b1fe86311740</uuid>
Oct 25 16:36:12 user nova-compute[74048]:   <name>instance-00000011</name>
Oct 25 16:36:12 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:36:12 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:36:12 user nova-compute[74048]:   <metadata>
Oct 25 16:36:12 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:36:12 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:36:12 user nova-compute[74048]:       <nova:name>tempest-TestShelveInstance-server-343536256</nova:name>
Oct 25 16:36:12 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:36:11</nova:creationTime>
Oct 25 16:36:12 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:36:12 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:36:12 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:36:12 user nova-compute[74048]:       <nova:owner>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:user uuid="48ec0ba2f8824a2bacee58bf893a77d0">tempest-TestShelveInstance-686947210-project-member</nova:user>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:project uuid="00f7ca267a294268b08d2452f427f8b2">tempest-TestShelveInstance-686947210</nova:project>
Oct 25 16:36:12 user nova-compute[74048]:       </nova:owner>
Oct 25 16:36:12 user nova-compute[74048]:       <nova:ports>
Oct 25 16:36:12 user nova-compute[74048]:         <nova:port uuid="c39060db-5027-4548-993a-9975c447cfb7">
Oct 25 16:36:12 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 16:36:12 user nova-compute[74048]:         </nova:port>
Oct 25 16:36:12 user nova-compute[74048]:       </nova:ports>
Oct 25 16:36:12 user nova-compute[74048]:     </nova:instance>
Oct 25 16:36:12 user nova-compute[74048]:   </metadata>
Oct 25 16:36:12 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:36:12 user nova-compute[74048]:     <system>
Oct 25 16:36:12 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:36:12 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:36:12 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:36:12 user nova-compute[74048]:       <entry name="serial">95c95f8e-996a-4ce3-a32d-b1fe86311740</entry>
Oct 25 16:36:12 user nova-compute[74048]:       <entry name="uuid">95c95f8e-996a-4ce3-a32d-b1fe86311740</entry>
Oct 25 16:36:12 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:36:12 user nova-compute[74048]:     </system>
Oct 25 16:36:12 user nova-compute[74048]:   </sysinfo>
Oct 25 16:36:12 user nova-compute[74048]:   <os>
Oct 25 16:36:12 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:36:12 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:36:12 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:36:12 user nova-compute[74048]:   </os>
Oct 25 16:36:12 user nova-compute[74048]:   <features>
Oct 25 16:36:12 user nova-compute[74048]:     <acpi/>
Oct 25 16:36:12 user nova-compute[74048]:     <apic/>
Oct 25 16:36:12 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:36:12 user nova-compute[74048]:   </features>
Oct 25 16:36:12 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:36:12 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:36:12 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:36:12 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:36:12 user nova-compute[74048]:   </clock>
Oct 25 16:36:12 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:36:12 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:36:12 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:36:12 user nova-compute[74048]:   </cpu>
Oct 25 16:36:12 user nova-compute[74048]:   <devices>
Oct 25 16:36:12 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:36:12 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:36:12 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:36:12 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:36:12 user nova-compute[74048]:       <serial>da74e58d-992d-40ad-9773-00eb07783c44</serial>
Oct 25 16:36:12 user nova-compute[74048]:     </disk>
Oct 25 16:36:12 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:36:12 user nova-compute[74048]:       <mac address="fa:16:3e:bc:fb:95"/>
Oct 25 16:36:12 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:36:12 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:36:12 user nova-compute[74048]:       <target dev="tapc39060db-50"/>
Oct 25 16:36:12 user nova-compute[74048]:     </interface>
Oct 25 16:36:12 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:36:12 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740/console.log" append="off"/>
Oct 25 16:36:12 user nova-compute[74048]:     </serial>
Oct 25 16:36:12 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:36:12 user nova-compute[74048]:     <video>
Oct 25 16:36:12 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:36:12 user nova-compute[74048]:     </video>
Oct 25 16:36:12 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:36:12 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:36:12 user nova-compute[74048]:     </rng>
Oct 25 16:36:12 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:36:12 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:36:12 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:36:12 user nova-compute[74048]:     </memballoon>
Oct 25 16:36:12 user nova-compute[74048]:   </devices>
Oct 25 16:36:12 user nova-compute[74048]: </domain>
Oct 25 16:36:12 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-343536256',display_name='tempest-TestShelveInstance-server-343536256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-343536256',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2011198275',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='00f7ca267a294268b08d2452f427f8b2',ramdisk_id='',reservation_id='r-bcsns6bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-686947210',owner_user_name='tempest-TestShelveInstance-686947210-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:35:50Z,user_data=None,user_id='48ec0ba2f8824a2bacee58bf893a77d0',uuid=95c95f8e-996a-4ce3-a32d-b1fe86311740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converting VIF {"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG os_vif [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17d25f83-8336-58b4-b6c5-de8cefeb13cc', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc39060db-50, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc39060db-50, col_values=(('qos', UUID('f950b37b-0b9f-484c-82fc-0f9026afc279')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc39060db-50, col_values=(('external_ids', {'iface-id': 'c39060db-5027-4548-993a-9975c447cfb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:fb:95', 'vm-uuid': '95c95f8e-996a-4ce3-a32d-b1fe86311740'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:13 user nova-compute[74048]: INFO os_vif [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50')
Oct 25 16:36:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:36:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] No VIF found with MAC fa:16:3e:bc:fb:95, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-beb9fa6d-7c88-445d-b6ad-1bbec73b2761 req-69a1e5d5-9f08-43c3-9d63-55779c885c5e service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-beb9fa6d-7c88-445d-b6ad-1bbec73b2761 req-69a1e5d5-9f08-43c3-9d63-55779c885c5e service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-beb9fa6d-7c88-445d-b6ad-1bbec73b2761 req-69a1e5d5-9f08-43c3-9d63-55779c885c5e service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-beb9fa6d-7c88-445d-b6ad-1bbec73b2761 req-69a1e5d5-9f08-43c3-9d63-55779c885c5e service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-beb9fa6d-7c88-445d-b6ad-1bbec73b2761 req-69a1e5d5-9f08-43c3-9d63-55779c885c5e service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:14 user nova-compute[74048]: WARNING nova.compute.manager [req-beb9fa6d-7c88-445d-b6ad-1bbec73b2761 req-69a1e5d5-9f08-43c3-9d63-55779c885c5e service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 16:36:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a0b4a48-66c7-4d11-a1b0-fbcad1b3c694 req-88534999-2e34-4a1f-86d9-b6d8552ce82a service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a0b4a48-66c7-4d11-a1b0-fbcad1b3c694 req-88534999-2e34-4a1f-86d9-b6d8552ce82a service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a0b4a48-66c7-4d11-a1b0-fbcad1b3c694 req-88534999-2e34-4a1f-86d9-b6d8552ce82a service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a0b4a48-66c7-4d11-a1b0-fbcad1b3c694 req-88534999-2e34-4a1f-86d9-b6d8552ce82a service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a0b4a48-66c7-4d11-a1b0-fbcad1b3c694 req-88534999-2e34-4a1f-86d9-b6d8552ce82a service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:16 user nova-compute[74048]: WARNING nova.compute.manager [req-7a0b4a48-66c7-4d11-a1b0-fbcad1b3c694 req-88534999-2e34-4a1f-86d9-b6d8552ce82a service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 16:36:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance spawned successfully.
Oct 25 16:36:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:36:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-958f1fe5-65ae-43e1-b845-314217e6a7ba tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.440s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'pci_requests' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'numa_topology' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:17 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:36:17 user nova-compute[74048]: INFO nova.compute.claims [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Claim successful on node user
Oct 25 16:36:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:18 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:36:18 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:36:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:18 user nova-compute[74048]: INFO nova.network.neutron [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating port 1226b11a-beef-408e-b4b4-bf13383c8cde with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquired lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-changed-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Refreshing instance network info cache due to event network-changed-1226b11a-beef-408e-b4b4-bf13383c8cde. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] Acquiring lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Releasing lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:36:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Creating image(s)
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.objects.instance [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] Acquired lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Refreshing network info cache for port 1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG nova.objects.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<30783ca1-6eb2-4c19-907c-f4e84ca696ac> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "b0a24dd5bb7a5b58058bccc46795ddba2e729fdc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "b0a24dd5bb7a5b58058bccc46795ddba2e729fdc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG nova.virt.images [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] 677be60e-fb60-4d7d-b9f8-9b1829a9ed68 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.part /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updated VIF entry in instance network info cache for port 1226b11a-beef-408e-b4b4-bf13383c8cde. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:36:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e03657e-8b9b-4d1c-97be-79bb4a5ba851 req-618ef7a4-1a6d-4896-a5b1-d3c56be87962 service nova] Releasing lock "refresh_cache-30783ca1-6eb2-4c19-907c-f4e84ca696ac" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.part /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.converted" returned: 0 in 0.394s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "b0a24dd5bb7a5b58058bccc46795ddba2e729fdc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.745s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "b0a24dd5bb7a5b58058bccc46795ddba2e729fdc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "b0a24dd5bb7a5b58058bccc46795ddba2e729fdc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc,backing_fmt=raw /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc,backing_fmt=raw /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk 1073741824" returned: 0 in 0.047s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "b0a24dd5bb7a5b58058bccc46795ddba2e729fdc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:21 user nova-compute[74048]: DEBUG nova.objects.instance [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'migration_context' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:22 user nova-compute[74048]: DEBUG nova.objects.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<30783ca1-6eb2-4c19-907c-f4e84ca696ac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:36:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Rebasing disk image.
Oct 25 16:36:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 -F raw /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 -F raw /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk" returned: 0 in 2.220s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Ensure instance console log exists: /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Start _get_guest_xml network_info=[{"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='7de61afbf8a9e5192d6011134adaa8c2',container_format='bare',created_at=2023-10-25T16:34:06Z,direct_url=<?>,disk_format='qcow2',id=677be60e-fb60-4d7d-b9f8-9b1829a9ed68,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-93929825-shelved',owner='5dc9602800254bc4bf71768c629c59cf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T16:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': 'dfd3029f-9a20-465a-8041-04e51e54b570', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAjuwQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '30783ca1-6eb2-4c19-907c-f4e84ca696ac', 'attached_at': '', 'detached_at': '', 'volume_id': '7a32bf78-dc59-4c78-ab85-776a570d7e6f', 'serial': '7a32bf78-dc59-4c78-ab85-776a570d7e6f'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:36:24 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:36:24 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7de61afbf8a9e5192d6011134adaa8c2',container_format='bare',created_at=2023-10-25T16:34:06Z,direct_url=<?>,disk_format='qcow2',id=677be60e-fb60-4d7d-b9f8-9b1829a9ed68,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-93929825-shelved',owner='5dc9602800254bc4bf71768c629c59cf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T16:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.objects.instance [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.objects.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<30783ca1-6eb2-4c19-907c-f4e84ca696ac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAjuwQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:36:24 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:36:24 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:36:24 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260" returned: 21 in 0.042s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0575b6c-29a0-435d-9ecc-8d533dd6483f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:36:24 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c86a775-d760-457b-a511-3b528f2d9e6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f] added
Oct 25 16:36:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494c77e-f4e4-45a6-9978-70599d05ae43]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50dc9b1-883e-475d-9823-25a370c7edd9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbAjuwQE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbAjuwQE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516df43-ac26-4beb-a2a2-a5c1f22c5d11]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbAjuwQE'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab18826-d673-4f02-acb8-47503fff01ab]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e821b-44f7-4d9c-8f46-a4689ea480d0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf5caa-4af7-4be0-88f4-0d5dd751b93e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260]
Oct 25 16:36:24 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260] successful.
Oct 25 16:36:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e06c0d-63b2-490c-aba4-6505eacef15f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c3453e-0404-4ad6-bf78-a07ea5fe736f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:36:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:36:24 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:36:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a70656a-2f27-4be0-adaa-e18abd4abfe4]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAjuwQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23262373435383131', 'path': '/dev/sde'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262373435383131', 'path': '/dev/sde'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-93929825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-93929825',id=18,image_ref='677be60e-fb60-4d7d-b9f8-9b1829a9ed68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-513469368',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-8ltesbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member',shelved_at='2023-10-25T16:34:11.658361',shelved_host='user',shelved_image_id='677be60e-fb60-4d7d-b9f8-9b1829a9ed68'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=30783ca1-6eb2-4c19-907c-f4e84ca696ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.objects.instance [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'pci_devices' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.objects.base [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<30783ca1-6eb2-4c19-907c-f4e84ca696ac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:36:25 user nova-compute[74048]:   <uuid>30783ca1-6eb2-4c19-907c-f4e84ca696ac</uuid>
Oct 25 16:36:25 user nova-compute[74048]:   <name>instance-00000012</name>
Oct 25 16:36:25 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:36:25 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:36:25 user nova-compute[74048]:   <metadata>
Oct 25 16:36:25 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:36:25 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:36:25 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-93929825</nova:name>
Oct 25 16:36:25 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:36:24</nova:creationTime>
Oct 25 16:36:25 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:36:25 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:36:25 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:36:25 user nova-compute[74048]:       <nova:owner>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:user uuid="b8fb16c6fa0c4e3a8e8b05bd0222b4ba">tempest-AttachVolumeShelveTestJSON-1185084699-project-member</nova:user>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:project uuid="5dc9602800254bc4bf71768c629c59cf">tempest-AttachVolumeShelveTestJSON-1185084699</nova:project>
Oct 25 16:36:25 user nova-compute[74048]:       </nova:owner>
Oct 25 16:36:25 user nova-compute[74048]:       <nova:root type="image" uuid="677be60e-fb60-4d7d-b9f8-9b1829a9ed68"/>
Oct 25 16:36:25 user nova-compute[74048]:       <nova:ports>
Oct 25 16:36:25 user nova-compute[74048]:         <nova:port uuid="1226b11a-beef-408e-b4b4-bf13383c8cde">
Oct 25 16:36:25 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 16:36:25 user nova-compute[74048]:         </nova:port>
Oct 25 16:36:25 user nova-compute[74048]:       </nova:ports>
Oct 25 16:36:25 user nova-compute[74048]:     </nova:instance>
Oct 25 16:36:25 user nova-compute[74048]:   </metadata>
Oct 25 16:36:25 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:36:25 user nova-compute[74048]:     <system>
Oct 25 16:36:25 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:36:25 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:36:25 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:36:25 user nova-compute[74048]:       <entry name="serial">30783ca1-6eb2-4c19-907c-f4e84ca696ac</entry>
Oct 25 16:36:25 user nova-compute[74048]:       <entry name="uuid">30783ca1-6eb2-4c19-907c-f4e84ca696ac</entry>
Oct 25 16:36:25 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:36:25 user nova-compute[74048]:     </system>
Oct 25 16:36:25 user nova-compute[74048]:   </sysinfo>
Oct 25 16:36:25 user nova-compute[74048]:   <os>
Oct 25 16:36:25 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:36:25 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:36:25 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:36:25 user nova-compute[74048]:   </os>
Oct 25 16:36:25 user nova-compute[74048]:   <features>
Oct 25 16:36:25 user nova-compute[74048]:     <acpi/>
Oct 25 16:36:25 user nova-compute[74048]:     <apic/>
Oct 25 16:36:25 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:36:25 user nova-compute[74048]:   </features>
Oct 25 16:36:25 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:36:25 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:36:25 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:36:25 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:36:25 user nova-compute[74048]:   </clock>
Oct 25 16:36:25 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:36:25 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:36:25 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:36:25 user nova-compute[74048]:   </cpu>
Oct 25 16:36:25 user nova-compute[74048]:   <devices>
Oct 25 16:36:25 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:36:25 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:36:25 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk"/>
Oct 25 16:36:25 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:36:25 user nova-compute[74048]:     </disk>
Oct 25 16:36:25 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:36:25 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:36:25 user nova-compute[74048]:       <source dev="/dev/sde"/>
Oct 25 16:36:25 user nova-compute[74048]:       <target dev="vdc" bus="virtio"/>
Oct 25 16:36:25 user nova-compute[74048]:       <serial>7a32bf78-dc59-4c78-ab85-776a570d7e6f</serial>
Oct 25 16:36:25 user nova-compute[74048]:     </disk>
Oct 25 16:36:25 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:36:25 user nova-compute[74048]:       <mac address="fa:16:3e:d6:46:f8"/>
Oct 25 16:36:25 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:36:25 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:36:25 user nova-compute[74048]:       <target dev="tap1226b11a-be"/>
Oct 25 16:36:25 user nova-compute[74048]:     </interface>
Oct 25 16:36:25 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:36:25 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/console.log" append="off"/>
Oct 25 16:36:25 user nova-compute[74048]:     </serial>
Oct 25 16:36:25 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:36:25 user nova-compute[74048]:     <video>
Oct 25 16:36:25 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:36:25 user nova-compute[74048]:     </video>
Oct 25 16:36:25 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:36:25 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:36:25 user nova-compute[74048]:     </rng>
Oct 25 16:36:25 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:36:25 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:36:25 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:36:25 user nova-compute[74048]:     </memballoon>
Oct 25 16:36:25 user nova-compute[74048]:   </devices>
Oct 25 16:36:25 user nova-compute[74048]: </domain>
Oct 25 16:36:25 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-93929825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-93929825',id=18,image_ref='677be60e-fb60-4d7d-b9f8-9b1829a9ed68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-513469368',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-8ltesbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member',shelved_at='2023-10-25T16:34:11.658361',shelved_host='user',shelved_image_id='677be60e-fb60-4d7d-b9f8-9b1829a9ed68'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=30783ca1-6eb2-4c19-907c-f4e84ca696ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG os_vif [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13938fcb-9f0c-5d90-a38d-3c8711d52540', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1226b11a-be, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1226b11a-be, col_values=(('qos', UUID('028df166-8c4a-4a80-9dfe-38dca6c79d60')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1226b11a-be, col_values=(('external_ids', {'iface-id': '1226b11a-beef-408e-b4b4-bf13383c8cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:46:f8', 'vm-uuid': '30783ca1-6eb2-4c19-907c-f4e84ca696ac'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:36:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:26 user nova-compute[74048]: INFO os_vif [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be')
Oct 25 16:36:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:36:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:36:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No VIF found with MAC fa:16:3e:d6:46:f8, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-836ef736-124e-4c92-9c20-bb44bcbbf905 req-be6761c0-27c4-42a0-b3c4-bf94bfd01118 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-836ef736-124e-4c92-9c20-bb44bcbbf905 req-be6761c0-27c4-42a0-b3c4-bf94bfd01118 service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-836ef736-124e-4c92-9c20-bb44bcbbf905 req-be6761c0-27c4-42a0-b3c4-bf94bfd01118 service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-836ef736-124e-4c92-9c20-bb44bcbbf905 req-be6761c0-27c4-42a0-b3c4-bf94bfd01118 service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-836ef736-124e-4c92-9c20-bb44bcbbf905 req-be6761c0-27c4-42a0-b3c4-bf94bfd01118 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:27 user nova-compute[74048]: WARNING nova.compute.manager [req-836ef736-124e-4c92-9c20-bb44bcbbf905 req-be6761c0-27c4-42a0-b3c4-bf94bfd01118 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 16:36:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:36:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:36:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance spawned successfully.
Oct 25 16:36:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-1dc6d34c-5a2d-4953-b8e6-98bc207d3a49 req-54e83a12-dff0-43b0-818e-53927eb3b0af service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1dc6d34c-5a2d-4953-b8e6-98bc207d3a49 req-54e83a12-dff0-43b0-818e-53927eb3b0af service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1dc6d34c-5a2d-4953-b8e6-98bc207d3a49 req-54e83a12-dff0-43b0-818e-53927eb3b0af service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1dc6d34c-5a2d-4953-b8e6-98bc207d3a49 req-54e83a12-dff0-43b0-818e-53927eb3b0af service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-1dc6d34c-5a2d-4953-b8e6-98bc207d3a49 req-54e83a12-dff0-43b0-818e-53927eb3b0af service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:29 user nova-compute[74048]: WARNING nova.compute.manager [req-1dc6d34c-5a2d-4953-b8e6-98bc207d3a49 req-54e83a12-dff0-43b0-818e-53927eb3b0af service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 16:36:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:36:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-acf2fd68-a370-46b5-80cc-2c15badbc88d tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.762s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:38 user nova-compute[74048]: INFO nova.compute.manager [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Terminating instance
Oct 25 16:36:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-baeaa963-b20b-4483-a12c-8f9e71bd43a5 req-f1150e1b-615b-4188-bf5a-6937e72915e7 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-vif-unplugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-baeaa963-b20b-4483-a12c-8f9e71bd43a5 req-f1150e1b-615b-4188-bf5a-6937e72915e7 service nova] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-baeaa963-b20b-4483-a12c-8f9e71bd43a5 req-f1150e1b-615b-4188-bf5a-6937e72915e7 service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-baeaa963-b20b-4483-a12c-8f9e71bd43a5 req-f1150e1b-615b-4188-bf5a-6937e72915e7 service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-baeaa963-b20b-4483-a12c-8f9e71bd43a5 req-f1150e1b-615b-4188-bf5a-6937e72915e7 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] No waiting events found dispatching network-vif-unplugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-baeaa963-b20b-4483-a12c-8f9e71bd43a5 req-f1150e1b-615b-4188-bf5a-6937e72915e7 service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-vif-unplugged-82dbd447-aff0-4c3e-ac60-7395297d3844 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:36:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Instance destroyed successfully.
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lazy-loading 'resources' on Instance uuid 0ad0d06b-51a7-469a-a11d-2416c00b94f1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2093880244',display_name='tempest-TestServerVolumeAttachmentScenario-server-2093880244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2093880244',id=19,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLcMmg1dqm4xc9ZaANT8hMmFOQ7C5dTgWkFUVY9SxOXxDKm35jDYFK4/tFGqzP3MhVlTUr9e4BKbOzgH8IAPmmRH5dMq2uYafIJzUus9dTLHdM78uqxk/IZM4XNMvW3jA==',key_name='tempest-keypair-1407394885',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79842d08a1c14aa7ac769c4bcd476226',ramdisk_id='',reservation_id='r-4pjo1ri7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2054789310',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2054789310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a9cf7fdde74b5a9eb622bfe8aec460',uuid=0ad0d06b-51a7-469a-a11d-2416c00b94f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Converting VIF {"id": "82dbd447-aff0-4c3e-ac60-7395297d3844", "address": "fa:16:3e:be:18:42", "network": {"id": "0bc38578-f5a1-4383-91f2-88b1554577b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1584543550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79842d08a1c14aa7ac769c4bcd476226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82dbd447-af", "ovs_interfaceid": "82dbd447-aff0-4c3e-ac60-7395297d3844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG os_vif [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82dbd447-af, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb664316-f101-4702-9814-e6682eac842c) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:36:39 user nova-compute[74048]: INFO os_vif [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:18:42,bridge_name='br-int',has_traffic_filtering=True,id=82dbd447-aff0-4c3e-ac60-7395297d3844,network=Network(0bc38578-f5a1-4383-91f2-88b1554577b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82dbd447-af')
Oct 25 16:36:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Deleting instance files /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1_del
Oct 25 16:36:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Deletion of /opt/stack/data/nova/instances/0ad0d06b-51a7-469a-a11d-2416c00b94f1_del complete
Oct 25 16:36:39 user nova-compute[74048]: INFO nova.compute.manager [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 16:36:39 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:36:39 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:40 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Took 0.70 seconds to deallocate network for instance.
Oct 25 16:36:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-bdd2b3ac-1f17-459a-b457-3e527644f7d7 req-2f0aa68c-bd59-440a-b0a8-9885b487aa9a service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-vif-deleted-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:36:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:40 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Deleted allocations for instance 0ad0d06b-51a7-469a-a11d-2416c00b94f1
Oct 25 16:36:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a4d2bd5b-3604-4109-b1e1-c80051d73c63 tempest-TestServerVolumeAttachmentScenario-2054789310 tempest-TestServerVolumeAttachmentScenario-2054789310-project-member] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-e28538f5-7f01-47a0-af55-705cb6d614dd req-2c9fc2d7-4d47-4b66-b894-27f112b515fd service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received event network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e28538f5-7f01-47a0-af55-705cb6d614dd req-2c9fc2d7-4d47-4b66-b894-27f112b515fd service nova] Acquiring lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e28538f5-7f01-47a0-af55-705cb6d614dd req-2c9fc2d7-4d47-4b66-b894-27f112b515fd service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e28538f5-7f01-47a0-af55-705cb6d614dd req-2c9fc2d7-4d47-4b66-b894-27f112b515fd service nova] Lock "0ad0d06b-51a7-469a-a11d-2416c00b94f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-e28538f5-7f01-47a0-af55-705cb6d614dd req-2c9fc2d7-4d47-4b66-b894-27f112b515fd service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] No waiting events found dispatching network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:36:41 user nova-compute[74048]: WARNING nova.compute.manager [req-e28538f5-7f01-47a0-af55-705cb6d614dd req-2c9fc2d7-4d47-4b66-b894-27f112b515fd service nova] [instance: 0ad0d06b-51a7-469a-a11d-2416c00b94f1] Received unexpected event network-vif-plugged-82dbd447-aff0-4c3e-ac60-7395297d3844 for instance with vm_state deleted and task_state None.
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [{"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-f436dc02-f6f1-4e54-8d87-608a462a107c" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:36:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:45 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json" returned: 0 in 0.282s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-changed-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Refreshing instance network info cache due to event network-changed-12a1be3f-29dd-4dfc-8be7-77df08c2c23e. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] Acquiring lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] Acquired lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG nova.network.neutron [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Refreshing network info cache for port 12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:36:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:36:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:36:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7333MB free_disk=25.23955535888672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 105119ce-b27f-41a7-b466-2f6b1ca03077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 95c95f8e-996a-4ce3-a32d-b1fe86311740 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.network.neutron [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updated VIF entry in instance network info cache for port 12a1be3f-29dd-4dfc-8be7-77df08c2c23e. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.network.neutron [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updating instance_info_cache with network_info: [{"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb78d8a7-2f15-4711-ac6a-0e1018f46414 req-8bfb864b-d87a-4c28-a41a-d6dc3e52d4e0 service nova] Releasing lock "refresh_cache-105119ce-b27f-41a7-b466-2f6b1ca03077" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:36:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:36:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 105119ce-b27f-41a7-b466-2f6b1ca03077 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:36:56 user nova-compute[74048]: INFO nova.compute.manager [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Attaching volume dfcb65ee-4e65-49f1-92ec-46fb76ad904c to /dev/vdb
Oct 25 16:36:56 user nova-compute[74048]: DEBUG os_brick.utils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9744a61-0baf-42e3-873f-ecb0ea6538a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49e699e-df92-46b8-9763-e78a257a4d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c135d2-5f90-43b3-9676-fc7a50251ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a3c169-b69f-4bae-aee4-6e98b0b4d6be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:36:56 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:36:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e1842-1e61-4fc1-bbfd-139b5f3a810f]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG os_brick.utils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:36:56 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updating existing volume attachment record: 81e05fe4-f1de-4b40-8327-e324ca270dff {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:36:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'flavor' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgIyEvNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:14 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:14 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:14 user nova-compute[74048]: INFO nova.compute.manager [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Attaching volume 7871e2f8-746b-4bed-b5f6-c35104c08084 to /dev/vdb
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae3460b-4705-4b05-b23a-041f1394f455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:37:14 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c52e23-e500-4294-a4b4-d911df862d23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c] added
Oct 25 16:37:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.utils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d517f8b0-b2ec-4e2b-ab4c-c23c87353492]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c94e41-c1f6-4e04-9c92-5b7b109fb64e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3ad05-ae70-493b-97d9-ea8e37034b5f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgIyEvNt {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f153fe8f-d3f1-48fa-99be-36706fd28296]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cgIyEvNt" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d876fde-53d9-4cde-862d-6088b428339e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cgIyEvNt'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be75fa1-8114-4772-bdca-c1cbfdcede62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d967620-ac60-4db5-8afb-1588d0048ee5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[457dbcc1-7ec3-4493-8cb4-bffbe4a94c42]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:37:14 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[facdea46-f3c5-4f06-b13e-fd2d73b69dd4]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.utils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating existing volume attachment record: b4d65de8-b8e3-441d-ae24-11ee84241aa9 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e699c-4056-4cd8-9ecc-10bad1c7fddf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90326bf3-7bf3-4f2d-8f04-3be00f5bba8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260]
Oct 25 16:37:14 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260] successful.
Oct 25 16:37:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0349c2d1-cadb-4ae6-a5ab-611ad8b5c255]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[91810297-9790-49c6-82ce-8fa75105eb74]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:14 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:14 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ae416b-8c09-4f75-91a2-c228264b417c]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:14 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgIyEvNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23231633666333233', 'path': '/dev/sdf'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231633666333233', 'path': '/dev/sdf'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 105119ce-b27f-41a7-b466-2f6b1ca03077 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:15 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:37:15 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:15 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:37:15 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:37:15 user nova-compute[74048]:   <serial>dfcb65ee-4e65-49f1-92ec-46fb76ad904c</serial>
Oct 25 16:37:15 user nova-compute[74048]: </disk>
Oct 25 16:37:15 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:37:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No VIF found with MAC fa:16:3e:a4:ed:c2, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:37:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e89c9845-bb0b-43b1-a772-4ee06172047c tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.792s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:17 user nova-compute[74048]: INFO nova.compute.manager [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Detaching volume dfcb65ee-4e65-49f1-92ec-46fb76ad904c
Oct 25 16:37:17 user nova-compute[74048]: INFO nova.virt.block_device [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Attempting to driver detach volume dfcb65ee-4e65-49f1-92ec-46fb76ad904c from mountpoint /dev/vdb
Oct 25 16:37:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Attempting to detach device vdb from instance 105119ce-b27f-41a7-b466-2f6b1ca03077 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:37:17 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:17 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:37:17 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:37:17 user nova-compute[74048]:   <serial>dfcb65ee-4e65-49f1-92ec-46fb76ad904c</serial>
Oct 25 16:37:17 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:37:17 user nova-compute[74048]: </disk>
Oct 25 16:37:17 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:37:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully detached device vdb from instance 105119ce-b27f-41a7-b466-2f6b1ca03077 from the persistent domain config.
Oct 25 16:37:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 105119ce-b27f-41a7-b466-2f6b1ca03077 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:37:17 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:17 user nova-compute[74048]:   <source dev="/dev/sdf"/>
Oct 25 16:37:17 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:37:17 user nova-compute[74048]:   <serial>dfcb65ee-4e65-49f1-92ec-46fb76ad904c</serial>
Oct 25 16:37:17 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:37:17 user nova-compute[74048]: </disk>
Oct 25 16:37:17 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'flavor' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 105119ce-b27f-41a7-b466-2f6b1ca03077 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:18 user nova-compute[74048]: INFO nova.compute.manager [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Attaching volume 8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 to /dev/vdb
Oct 25 16:37:18 user nova-compute[74048]: DEBUG os_brick.utils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[af80fb5c-344c-452f-86e6-146bf417747d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928ae55-fc84-4a86-83f9-5c6754d760b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe959180-04df-47b5-8794-3b0c79df0e5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d4420e-3a66-442f-adb0-754374b1c3ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:37:18 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:37:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b41885-a804-4fc9-a819-cbf5d9417054]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG os_brick.utils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:18 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating existing volume attachment record: 0fe21cad-acef-44e8-9d80-f2f14b31c2e5 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:37:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:37:20 user nova-compute[74048]: INFO nova.compute.manager [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Rescuing
Oct 25 16:37:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:20 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-6958026e-38ff-45be-bd8b-113e4b6737de req-d67ce49f-a904-4fd9-ab1d-9f66e8ef5112 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6958026e-38ff-45be-bd8b-113e4b6737de req-d67ce49f-a904-4fd9-ab1d-9f66e8ef5112 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6958026e-38ff-45be-bd8b-113e4b6737de req-d67ce49f-a904-4fd9-ab1d-9f66e8ef5112 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6958026e-38ff-45be-bd8b-113e4b6737de req-d67ce49f-a904-4fd9-ab1d-9f66e8ef5112 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-6958026e-38ff-45be-bd8b-113e4b6737de req-d67ce49f-a904-4fd9-ab1d-9f66e8ef5112 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:21 user nova-compute[74048]: WARNING nova.compute.manager [req-6958026e-38ff-45be-bd8b-113e4b6737de req-d67ce49f-a904-4fd9-ab1d-9f66e8ef5112 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state active and task_state rescuing.
Oct 25 16:37:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:21 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance destroyed successfully.
Oct 25 16:37:21 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Attempting a stable device rescue
Oct 25 16:37:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74048) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:37:21 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Creating image(s)
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "/opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'trusted_certs' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "2f13c80841f22abf59843a0e3a5fc63505423bda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "2f13c80841f22abf59843a0e3a5fc63505423bda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:22 user nova-compute[74048]: DEBUG nova.virt.images [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] 90e7fd95-0a7c-4128-95b9-2a570ca7ffd0 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:37:22 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:37:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.part /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.part /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.converted" returned: 0 in 0.401s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-b3fa706d-4b44-487a-bd4a-e0ca8c4d19d7 req-8f87a459-afb2-455f-820b-3e61a6803140 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b3fa706d-4b44-487a-bd4a-e0ca8c4d19d7 req-8f87a459-afb2-455f-820b-3e61a6803140 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b3fa706d-4b44-487a-bd4a-e0ca8c4d19d7 req-8f87a459-afb2-455f-820b-3e61a6803140 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b3fa706d-4b44-487a-bd4a-e0ca8c4d19d7 req-8f87a459-afb2-455f-820b-3e61a6803140 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.compute.manager [req-b3fa706d-4b44-487a-bd4a-e0ca8c4d19d7 req-8f87a459-afb2-455f-820b-3e61a6803140 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:23 user nova-compute[74048]: WARNING nova.compute.manager [req-b3fa706d-4b44-487a-bd4a-e0ca8c4d19d7 req-8f87a459-afb2-455f-820b-3e61a6803140 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state active and task_state rescuing.
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "2f13c80841f22abf59843a0e3a5fc63505423bda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.724s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "2f13c80841f22abf59843a0e3a5fc63505423bda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "2f13c80841f22abf59843a0e3a5fc63505423bda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda,backing_fmt=raw /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda,backing_fmt=raw /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue" returned: 0 in 0.054s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "2f13c80841f22abf59843a0e3a5fc63505423bda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'migration_context' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<54b28e3c-f604-4d30-ac14-805da155813d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Start _get_guest_xml network_info=[{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "vif_mac": "fa:16:3e:ed:63:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '90e7fd95-0a7c-4128-95b9-2a570ca7ffd0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '95bc3c11-6050-4809-8427-c9a4ab6fa8bc', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '54b28e3c-f604-4d30-ac14-805da155813d', 'attached_at': '', 'detached_at': '', 'volume_id': '55a0cafc-b396-4943-8baa-b238e9958208', 'serial': '55a0cafc-b396-4943-8baa-b238e9958208'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'resources' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<54b28e3c-f604-4d30-ac14-805da155813d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'numa_topology' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<54b28e3c-f604-4d30-ac14-805da155813d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:23 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:37:23 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.objects.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<54b28e3c-f604-4d30-ac14-805da155813d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:23 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:23 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:23 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba76e8-91bb-4f5c-a846-8e207d837155]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LanFJviy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 16:37:23 user nova-compute[74048]: node.name = iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:37:23 user nova-compute[74048]: node.tpgt = -1
Oct 25 16:37:23 user nova-compute[74048]: node.startup = automatic
Oct 25 16:37:23 user nova-compute[74048]: node.leading_login = No
Oct 25 16:37:23 user nova-compute[74048]: iface.iscsi_ifacename = default
Oct 25 16:37:23 user nova-compute[74048]: iface.net_ifacename = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.ipaddress = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.prefix_len = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.hwaddress = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.transport_name = tcp
Oct 25 16:37:23 user nova-compute[74048]: iface.initiatorname = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.vlan_id = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.vlan_priority = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.vlan_state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.iface_num = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.mtu = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.port = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.bootproto = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.subnet_mask = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.gateway = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_alt_client_id = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_dns = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_learn_iqn = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_vendor_id_state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_vendor_id = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.dhcp_slp_da = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.fragmentation = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.gratuitous_arp = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.incoming_forwarding = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.tos_state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.tos = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.ttl = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.delayed_ack = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.tcp_nagle = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.tcp_wsf_state = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.tcp_wsf = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.tcp_timer_scale = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.tcp_timestamp = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.redirect = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.def_task_mgmt_timeout = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.header_digest = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.data_digest = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.immediate_data = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.initial_r2t = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.data_seq_inorder = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.data_pdu_inorder = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.erl = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.max_receive_data_len = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.first_burst_len = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.max_outstanding_r2t = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.max_burst_len = 0
Oct 25 16:37:23 user nova-compute[74048]: iface.chap_auth = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.bidi_chap = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.strict_login_compliance = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.discovery_auth = <empty>
Oct 25 16:37:23 user nova-compute[74048]: iface.discovery_logout = <empty>
Oct 25 16:37:23 user nova-compute[74048]: node.discovery_address = <empty>
Oct 25 16:37:23 user nova-compute[74048]: node.discovery_port = 0
Oct 25 16:37:23 user nova-compute[74048]: node.discovery_type = static
Oct 25 16:37:23 user nova-compute[74048]: node.session.initial_cmdsn = 0
Oct 25 16:37:23 user nova-compute[74048]: node.session.initial_login_retry_max = 8
Oct 25 16:37:23 user nova-compute[74048]: node.session.xmit_thread_priority = -20
Oct 25 16:37:23 user nova-compute[74048]: node.session.cmds_max = 128
Oct 25 16:37:23 user nova-compute[74048]: node.session.queue_depth = 32
Oct 25 16:37:23 user nova-compute[74048]: node.session.nr_sessions = 1
Oct 25 16:37:23 user nova-compute[74048]: node.session.auth.authmethod = CHAP
Oct 25 16:37:23 user nova-compute[74048]: node.session.auth.username = LanFJviy
Oct 25 16:37:23 user nova-compute[74048]: node.session.auth.password = ***
Oct 25 16:37:23 user nova-compute[74048]: node.session.auth.username_in = <empty>
Oct 25 16:37:23 user nova-compute[74048]: node.session.auth.password_in = <empty>
Oct 25 16:37:23 user nova-compute[74048]: node.session.auth.chap_algs = MD5
Oct 25 16:37:23 user nova-compute[74048]: node.session.timeo.replacement_timeout = 120
Oct 25 16:37:23 user nova-compute[74048]: node.session.err_timeo.abort_timeout = 15
Oct 25 16:37:23 user nova-compute[74048]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 16:37:23 user nova-compute[74048]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 16:37:23 user nova-compute[74048]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.FastAbort = Yes
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.InitialR2T = No
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.ImmediateData = Yes
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.MaxConnections = 1
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 16:37:23 user nova-compute[74048]: node.session.iscsi.ERL = 0
Oct 25 16:37:23 user nova-compute[74048]: node.session.scan = manual
Oct 25 16:37:23 user nova-compute[74048]: node.session.reopen_max = 0
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].address = 172.16.0.220
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].port = 3260
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].startup = manual
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].tcp.window_size = 524288
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].tcp.type_of_service = 0
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].timeo.logout_timeout = 15
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].timeo.login_timeout = 15
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].timeo.auth_timeout = 45
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].iscsi.DataDigest = None
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].iscsi.IFMarker = No
Oct 25 16:37:23 user nova-compute[74048]: node.conn[0].iscsi.OFMarker = No
Oct 25 16:37:23 user nova-compute[74048]: # END RECORD
Oct 25 16:37:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c44dbf-9c7a-4c76-ac96-6570b1e46752]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfdbea8-10ed-4bd0-a231-409b717f0e7f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LanFJviy {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LanFJviy" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[04804ffb-49a2-4cc6-9538-cc3f781e6674]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LanFJviy'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9015fc-ab0e-4475-9912-d19f3dff55da]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2d348d-4f33-4f90-a048-b21c2cad4149]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:24 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] HCTL ('35', '0', '0', 0) found on session 25 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08900237-8568-45c9-a36d-68a755ed3e4a]: (4, ('0 0 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching for a device in session 25 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '26661643533623833', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661643533623833', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1501783072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1501783072',id=25,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:36:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-lqxy30xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:36:02Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=54b28e3c-f604-4d30-ac14-805da155813d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "vif_mac": "fa:16:3e:ed:63:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "vif_mac": "fa:16:3e:ed:63:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'pci_devices' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.objects.base [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<54b28e3c-f604-4d30-ac14-805da155813d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:37:24 user nova-compute[74048]:   <uuid>54b28e3c-f604-4d30-ac14-805da155813d</uuid>
Oct 25 16:37:24 user nova-compute[74048]:   <name>instance-00000019</name>
Oct 25 16:37:24 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:37:24 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:37:24 user nova-compute[74048]:   <metadata>
Oct 25 16:37:24 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:37:24 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:37:24 user nova-compute[74048]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1501783072</nova:name>
Oct 25 16:37:24 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:37:23</nova:creationTime>
Oct 25 16:37:24 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:37:24 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:37:24 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:37:24 user nova-compute[74048]:       <nova:owner>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:user uuid="6a2170a4f3e541bea8147fbf3bc6b746">tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member</nova:user>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:project uuid="4412dd65efab430eb361b71f048d3575">tempest-ServerBootFromVolumeStableRescueTest-399579320</nova:project>
Oct 25 16:37:24 user nova-compute[74048]:       </nova:owner>
Oct 25 16:37:24 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:37:24 user nova-compute[74048]:       <nova:ports>
Oct 25 16:37:24 user nova-compute[74048]:         <nova:port uuid="da4f4f96-f7ae-49b9-988f-823a9abebd58">
Oct 25 16:37:24 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:37:24 user nova-compute[74048]:         </nova:port>
Oct 25 16:37:24 user nova-compute[74048]:       </nova:ports>
Oct 25 16:37:24 user nova-compute[74048]:     </nova:instance>
Oct 25 16:37:24 user nova-compute[74048]:   </metadata>
Oct 25 16:37:24 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:37:24 user nova-compute[74048]:     <system>
Oct 25 16:37:24 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:37:24 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:37:24 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:37:24 user nova-compute[74048]:       <entry name="serial">54b28e3c-f604-4d30-ac14-805da155813d</entry>
Oct 25 16:37:24 user nova-compute[74048]:       <entry name="uuid">54b28e3c-f604-4d30-ac14-805da155813d</entry>
Oct 25 16:37:24 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:37:24 user nova-compute[74048]:     </system>
Oct 25 16:37:24 user nova-compute[74048]:   </sysinfo>
Oct 25 16:37:24 user nova-compute[74048]:   <os>
Oct 25 16:37:24 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:37:24 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:37:24 user nova-compute[74048]:   </os>
Oct 25 16:37:24 user nova-compute[74048]:   <features>
Oct 25 16:37:24 user nova-compute[74048]:     <acpi/>
Oct 25 16:37:24 user nova-compute[74048]:     <apic/>
Oct 25 16:37:24 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:37:24 user nova-compute[74048]:   </features>
Oct 25 16:37:24 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:37:24 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:37:24 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:37:24 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:37:24 user nova-compute[74048]:   </clock>
Oct 25 16:37:24 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:37:24 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:37:24 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:37:24 user nova-compute[74048]:   </cpu>
Oct 25 16:37:24 user nova-compute[74048]:   <devices>
Oct 25 16:37:24 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:37:24 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:24 user nova-compute[74048]:       <source dev="/dev/sdd"/>
Oct 25 16:37:24 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:37:24 user nova-compute[74048]:       <serial>55a0cafc-b396-4943-8baa-b238e9958208</serial>
Oct 25 16:37:24 user nova-compute[74048]:     </disk>
Oct 25 16:37:24 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:37:24 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:37:24 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue"/>
Oct 25 16:37:24 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:37:24 user nova-compute[74048]:       <boot order="1"/>
Oct 25 16:37:24 user nova-compute[74048]:     </disk>
Oct 25 16:37:24 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:37:24 user nova-compute[74048]:       <mac address="fa:16:3e:ed:63:3e"/>
Oct 25 16:37:24 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:37:24 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:37:24 user nova-compute[74048]:       <target dev="tapda4f4f96-f7"/>
Oct 25 16:37:24 user nova-compute[74048]:     </interface>
Oct 25 16:37:24 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:37:24 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/console.log" append="off"/>
Oct 25 16:37:24 user nova-compute[74048]:     </serial>
Oct 25 16:37:24 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:37:24 user nova-compute[74048]:     <video>
Oct 25 16:37:24 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:37:24 user nova-compute[74048]:     </video>
Oct 25 16:37:24 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:37:24 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:37:24 user nova-compute[74048]:     </rng>
Oct 25 16:37:24 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:37:24 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:37:24 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:37:24 user nova-compute[74048]:     </memballoon>
Oct 25 16:37:24 user nova-compute[74048]:   </devices>
Oct 25 16:37:24 user nova-compute[74048]: </domain>
Oct 25 16:37:24 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:37:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance destroyed successfully.
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No VIF found with MAC fa:16:3e:ed:63:3e, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:37:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-32b059ea-89d8-4cff-b4da-e4bfee758361 req-3343a049-1949-4be8-a084-f8c2610cc080 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-32b059ea-89d8-4cff-b4da-e4bfee758361 req-3343a049-1949-4be8-a084-f8c2610cc080 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-32b059ea-89d8-4cff-b4da-e4bfee758361 req-3343a049-1949-4be8-a084-f8c2610cc080 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-32b059ea-89d8-4cff-b4da-e4bfee758361 req-3343a049-1949-4be8-a084-f8c2610cc080 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-32b059ea-89d8-4cff-b4da-e4bfee758361 req-3343a049-1949-4be8-a084-f8c2610cc080 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:25 user nova-compute[74048]: WARNING nova.compute.manager [req-32b059ea-89d8-4cff-b4da-e4bfee758361 req-3343a049-1949-4be8-a084-f8c2610cc080 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state active and task_state rescuing.
Oct 25 16:37:27 user nova-compute[74048]: INFO nova.compute.manager [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Unrescuing
Oct 25 16:37:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-33af4b83-4a3a-451f-8352-1bcdca538ecc req-71c341c5-44e0-46e5-a7ee-10606dcba8d8 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-33af4b83-4a3a-451f-8352-1bcdca538ecc req-71c341c5-44e0-46e5-a7ee-10606dcba8d8 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-33af4b83-4a3a-451f-8352-1bcdca538ecc req-71c341c5-44e0-46e5-a7ee-10606dcba8d8 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-33af4b83-4a3a-451f-8352-1bcdca538ecc req-71c341c5-44e0-46e5-a7ee-10606dcba8d8 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-33af4b83-4a3a-451f-8352-1bcdca538ecc req-71c341c5-44e0-46e5-a7ee-10606dcba8d8 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:27 user nova-compute[74048]: WARNING nova.compute.manager [req-33af4b83-4a3a-451f-8352-1bcdca538ecc req-71c341c5-44e0-46e5-a7ee-10606dcba8d8 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state active and task_state rescuing.
Oct 25 16:37:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f9317cd4-26c3-42d4-965e-112b0df8b346 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'flavor' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-875ebfcc-db43-46f3-b042-ecfa1d33f1a6 req-5eb2caba-566b-40ba-b01a-6d5300a8160b service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-875ebfcc-db43-46f3-b042-ecfa1d33f1a6 req-5eb2caba-566b-40ba-b01a-6d5300a8160b service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-875ebfcc-db43-46f3-b042-ecfa1d33f1a6 req-5eb2caba-566b-40ba-b01a-6d5300a8160b service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-875ebfcc-db43-46f3-b042-ecfa1d33f1a6 req-5eb2caba-566b-40ba-b01a-6d5300a8160b service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-875ebfcc-db43-46f3-b042-ecfa1d33f1a6 req-5eb2caba-566b-40ba-b01a-6d5300a8160b service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:28 user nova-compute[74048]: WARNING nova.compute.manager [req-875ebfcc-db43-46f3-b042-ecfa1d33f1a6 req-5eb2caba-566b-40ba-b01a-6d5300a8160b service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:37:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance destroyed successfully.
Oct 25 16:37:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:30 user nova-compute[74048]: WARNING nova.compute.manager [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:37:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:30 user nova-compute[74048]: WARNING nova.compute.manager [req-fadf5711-ac21-42a0-88d0-5059c0ae11af req-73998e37-38ca-44ef-913c-954cf342f2c9 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:37:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f2d942c7-6256-4eab-8075-cf82f27bec34 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-540ef785-cfe2-4c15-b895-d9dd2dff6083 req-a6d886a9-3cd0-4982-a38d-f2757e196a79 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-540ef785-cfe2-4c15-b895-d9dd2dff6083 req-a6d886a9-3cd0-4982-a38d-f2757e196a79 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-540ef785-cfe2-4c15-b895-d9dd2dff6083 req-a6d886a9-3cd0-4982-a38d-f2757e196a79 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-540ef785-cfe2-4c15-b895-d9dd2dff6083 req-a6d886a9-3cd0-4982-a38d-f2757e196a79 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-540ef785-cfe2-4c15-b895-d9dd2dff6083 req-a6d886a9-3cd0-4982-a38d-f2757e196a79 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:33 user nova-compute[74048]: WARNING nova.compute.manager [req-540ef785-cfe2-4c15-b895-d9dd2dff6083 req-a6d886a9-3cd0-4982-a38d-f2757e196a79 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:37:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:33 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:37:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad9fb1-2074-431d-b746-67644d3f714e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:37:34 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc144a7c-c474-4bc3-bf19-f49b5a964665]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084] added
Oct 25 16:37:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[47636443-323f-46b9-8257-496b2f737f67]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e2b8fb-ab6c-44bb-adaa-ddc322247176]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igkAQqRC {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igkAQqRC" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f66471-9bae-4773-999b-772bd1989364]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igkAQqRC'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b096dd3-17e0-4f3c-b58e-87da69b90a54]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d4924-d224-489a-a9ce-faadfe769721]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beb3482-d98f-42b5-ba38-96cafaba0eea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]
Oct 25 16:37:34 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.
Oct 25 16:37:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b0b536-9cb0-447a-a1bd-81d0ef6bb1fa]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d4877-5f2b-4702-a30e-ebb208fe1ca5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:34 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:34 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1c92fa-2e8a-4171-bf0e-05b576b4d327]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:37:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23066636264326135', 'path': '/dev/sdg'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066636264326135', 'path': '/dev/sdg'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'flavor' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:37:35 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:35 user nova-compute[74048]:   <source dev="/dev/sdg"/>
Oct 25 16:37:35 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:37:35 user nova-compute[74048]:   <serial>7871e2f8-746b-4bed-b5f6-c35104c08084</serial>
Oct 25 16:37:35 user nova-compute[74048]: </disk>
Oct 25 16:37:35 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No VIF found with MAC fa:16:3e:cc:19:90, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:37:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b5bb0ad3-7633-43f0-8f38-638b04fb3c8b tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.585s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOLRqeJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:37 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7833fd13-7a55-4a86-91e6-adb5314dd3ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:37:37 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4595277-c8d8-4a46-9a6e-70e6fa96e240]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0] added
Oct 25 16:37:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[604821bb-ed1f-4f6a-9322-51a01096bff8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7096eddc-2058-42e3-a467-a50358fe1645]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOLRqeJV {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOLRqeJV" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea555e-3422-4ea7-af2c-eeaf83bf5413]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOLRqeJV'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce0a41-f6b9-48df-81e7-0b7d4cb4d088]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04ef45-92ac-495c-9258-b1e5941d5848]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2272dfe-63c3-422f-8997-df46a8688f54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260]
Oct 25 16:37:37 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260] successful.
Oct 25 16:37:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 105119ce-b27f-41a7-b466-2f6b1ca03077 is timed out.
Oct 25 16:37:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully detached device vdb from instance 105119ce-b27f-41a7-b466-2f6b1ca03077 from the live domain config.
Oct 25 16:37:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cgIyEvNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed331db-9c7e-4dff-be9d-ae2ad3ddf699]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c0b7fc-45a8-4524-a1df-d38bba4b95a2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:37:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c78b64-76fa-4f46-bad9-12594a6ce8f1]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:37:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOLRqeJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23333363039303464', 'path': '/dev/sdh'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333363039303464', 'path': '/dev/sdh'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.092s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'flavor' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0fcf3b-4aff-45c0-ae5c-6ce68ed2fee3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:37:39 user nova-compute[74048]: No targets found.
Oct 25 16:37:39 user nova-compute[74048]: iSNS:
Oct 25 16:37:39 user nova-compute[74048]: No targets found.
Oct 25 16:37:39 user nova-compute[74048]: STATIC:
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44
Oct 25 16:37:39 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:39 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:39 user nova-compute[74048]: FIRMWARE:
Oct 25 16:37:39 user nova-compute[74048]: No targets found.
Oct 25 16:37:39 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:37:39 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:37:39 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:37:39 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:39 user nova-compute[74048]:   <source dev="/dev/sdh"/>
Oct 25 16:37:39 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:37:39 user nova-compute[74048]:   <serial>8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0</serial>
Oct 25 16:37:39 user nova-compute[74048]: </disk>
Oct 25 16:37:39 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3ce0d-91fe-47ae-a2e0-90b0bf96e104]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5720a74-df7d-4811-8c77-a7ee4fdf611e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:39 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840313910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c'): ({'sdf'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Removing single pathed devices sdf {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab3178-5307-4172-94b6-6192b528fc59]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.041s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1ad5eb-5a0a-440c-b259-ee117bf8d498]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flushing IO for device /dev/sdf {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef98fd8-0b76-4ae7-bcd5-722dacbbe106]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c6b874-cef6-4fd3-8651-4b0f6f55d4a4]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba9c6b8-b2aa-4f23-a3ef-085d5c6eb47c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ff2dd3-c365-4ea2-a966-fd529f7d4431]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260]
Oct 25 16:37:39 user nova-compute[74048]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c, portal: 172.16.0.220,3260] successful.
Oct 25 16:37:39 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfcb65ee-4e65-49f1-92ec-46fb76ad904c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c2645-0359-43ce-996c-45dd8eff0dd9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== disconnect_volume: return (1486ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No VIF found with MAC fa:16:3e:42:51:6d, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1e85926d-d98e-45b2-9f1f-c1a599c83e92 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.642s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG nova.objects.instance [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 105119ce-b27f-41a7-b466-2f6b1ca03077 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-89002378-84ca-46d5-922b-154d5e3ebd70 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.980s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-changed-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing instance network info cache due to event network-changed-c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] Acquiring lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] Acquired lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG nova.network.neutron [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Refreshing network info cache for port c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:40 user nova-compute[74048]: INFO nova.compute.manager [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Terminating instance
Oct 25 16:37:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-1224799e-662b-4a39-aee2-b8611f00cc20 req-1c6d4d6b-67f4-4151-b0bf-4d3f184167bd service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-unplugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1224799e-662b-4a39-aee2-b8611f00cc20 req-1c6d4d6b-67f4-4151-b0bf-4d3f184167bd service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1224799e-662b-4a39-aee2-b8611f00cc20 req-1c6d4d6b-67f4-4151-b0bf-4d3f184167bd service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1224799e-662b-4a39-aee2-b8611f00cc20 req-1c6d4d6b-67f4-4151-b0bf-4d3f184167bd service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-1224799e-662b-4a39-aee2-b8611f00cc20 req-1c6d4d6b-67f4-4151-b0bf-4d3f184167bd service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-unplugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-1224799e-662b-4a39-aee2-b8611f00cc20 req-1c6d4d6b-67f4-4151-b0bf-4d3f184167bd service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-unplugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:37:41 user nova-compute[74048]: INFO nova.compute.manager [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Rescuing
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.network.neutron [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updated VIF entry in instance network info cache for port c39060db-5027-4548-993a-9975c447cfb7. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.network.neutron [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [{"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7037951f-6c0c-43aa-9d54-203f4833825d req-4e1d300e-041b-47db-b6aa-a1bfa5cb796c service nova] Releasing lock "refresh_cache-95c95f8e-996a-4ce3-a32d-b1fe86311740" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Instance destroyed successfully.
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lazy-loading 'resources' on Instance uuid 95c95f8e-996a-4ce3-a32d-b1fe86311740 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-343536256',display_name='tempest-TestShelveInstance-server-343536256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-343536256',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1IrdCkUUsHiV4icGuo9klRC+AVh2R+t1h7+7dspODqRK7xS07YszymAEkMfWrLm/UKAwlnB8NXR9szHIk+yQLsI/8Et7KHEOjfK/t9THvLoo2mbxwRyL2LE80LH/RaSA==',key_name='tempest-TestShelveInstance-2011198275',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00f7ca267a294268b08d2452f427f8b2',ramdisk_id='',reservation_id='r-bcsns6bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-686947210',owner_user_name='tempest-TestShelveInstance-686947210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:36:17Z,user_data=None,user_id='48ec0ba2f8824a2bacee58bf893a77d0',uuid=95c95f8e-996a-4ce3-a32d-b1fe86311740,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converting VIF {"id": "c39060db-5027-4548-993a-9975c447cfb7", "address": "fa:16:3e:bc:fb:95", "network": {"id": "a5220483-1a1b-47d0-988c-143da4df2a9d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1117651747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00f7ca267a294268b08d2452f427f8b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc39060db-50", "ovs_interfaceid": "c39060db-5027-4548-993a-9975c447cfb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_vif [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc39060db-50, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f950b37b-0b9f-484c-82fc-0f9026afc279) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:41 user nova-compute[74048]: INFO os_vif [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:95,bridge_name='br-int',has_traffic_filtering=True,id=c39060db-5027-4548-993a-9975c447cfb7,network=Network(a5220483-1a1b-47d0-988c-143da4df2a9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc39060db-50')
Oct 25 16:37:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgPBLTxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:41 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c678717-f961-49cb-8857-b1a0f4dacabf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:37:41 user nova-compute[74048]: No targets found.
Oct 25 16:37:41 user nova-compute[74048]: iSNS:
Oct 25 16:37:41 user nova-compute[74048]: No targets found.
Oct 25 16:37:41 user nova-compute[74048]: STATIC:
Oct 25 16:37:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:37:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f
Oct 25 16:37:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:37:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:37:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:37:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44
Oct 25 16:37:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:37:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:37:41 user nova-compute[74048]: FIRMWARE:
Oct 25 16:37:41 user nova-compute[74048]: No targets found.
Oct 25 16:37:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:37:41 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:37:41 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1718c06-73bb-4f22-8182-125d0d99c1a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b056572-8253-4143-b39c-a656467c81b9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185f32a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[285f648a-6b4b-470c-b53f-58a06a958989]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[35225e87-1939-48a0-a642-f92e3ac79cc0]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38d82c-d3f8-4fc6-a530-3b1ec349fd54]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4f193-24e5-40df-ac7f-6c440d0ccb52]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c4e288-1e5e-4413-a790-0a5ae2ecb799]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[51edb8b3-f4c9-4eab-9171-d2720f34ca3d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260]
Oct 25 16:37:42 user nova-compute[74048]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44, portal: 172.16.0.220,3260] successful.
Oct 25 16:37:42 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da74e58d-992d-40ad-9773-00eb07783c44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b0204c-82d6-4e1b-b2bb-75c158fbc463]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] <== disconnect_volume: return (395ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:37:42 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Deleting instance files /opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740_del
Oct 25 16:37:42 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Deletion of /opt/stack/data/nova/instances/95c95f8e-996a-4ce3-a32d-b1fe86311740_del complete
Oct 25 16:37:42 user nova-compute[74048]: INFO nova.compute.manager [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [{"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-51f3e782-7fc1-4de3-9d74-1d29f3ef9054" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:42 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Took 0.45 seconds to deallocate network for instance.
Oct 25 16:37:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-258b6fca-9508-4f66-8775-ee1c5dea79e9 req-8cc19cd4-7cd9-4621-907b-6b3bde555ca3 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-deleted-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Acquiring lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] No waiting events found dispatching network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:43 user nova-compute[74048]: WARNING nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Received unexpected event network-vif-plugged-c39060db-5027-4548-993a-9975c447cfb7 for instance with vm_state active and task_state deleting.
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:43 user nova-compute[74048]: WARNING nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state active and task_state rescuing.
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:43 user nova-compute[74048]: WARNING nova.compute.manager [req-fa11d146-2171-457b-88b1-d41eeda1c048 req-3d073792-9db5-4e8f-88e8-9d51bd5ab8d9 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state active and task_state rescuing.
Oct 25 16:37:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance destroyed successfully.
Oct 25 16:37:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Attempting a stable device rescue
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74048) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:37:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Creating image(s)
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "e57772a6e90e723973b7e24b2289ad34795e8f86" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "e57772a6e90e723973b7e24b2289ad34795e8f86" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:43 user nova-compute[74048]: INFO nova.compute.manager [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Took 0.95 seconds to detach 1 volumes for instance.
Oct 25 16:37:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] [instance: 95c95f8e-996a-4ce3-a32d-b1fe86311740] Deleting volume: da74e58d-992d-40ad-9773-00eb07783c44 {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.part --force-share --output=json" returned: 0 in 0.252s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG nova.virt.images [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] f811b98a-fe19-45b2-afcf-0f7abefa24b2 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:37:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.part /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.845s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.part /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.converted" returned: 0 in 0.772s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:45 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Deleted allocations for instance 95c95f8e-996a-4ce3-a32d-b1fe86311740
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-changed-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Refreshing instance network info cache due to event network-changed-b225761b-69af-459c-ad4e-8901ba049969. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Refreshing network info cache for port b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a748f145-dc86-4b60-8d71-70e2dc6bb9e7 tempest-TestShelveInstance-686947210 tempest-TestShelveInstance-686947210-project-member] Lock "95c95f8e-996a-4ce3-a32d-b1fe86311740" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.168s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:45 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86.converted --force-share --output=json" returned: 0 in 0.289s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "e57772a6e90e723973b7e24b2289ad34795e8f86" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.496s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "e57772a6e90e723973b7e24b2289ad34795e8f86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "e57772a6e90e723973b7e24b2289ad34795e8f86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86 --force-share --output=json" returned: 0 in 0.276s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86,backing_fmt=raw /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86,backing_fmt=raw /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue" returned: 0 in 0.080s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "e57772a6e90e723973b7e24b2289ad34795e8f86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'migration_context' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Object Instance<ed271afb-bdb0-418f-b759-ad86ea0a79a0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Start _get_guest_xml network_info=[{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "vif_mac": "fa:16:3e:42:51:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f811b98a-fe19-45b2-afcf-0f7abefa24b2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '0fe21cad-acef-44e8-9d80-f2f14b31c2e5', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOLRqeJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'ed271afb-bdb0-418f-b759-ad86ea0a79a0', 'attached_at': '', 'detached_at': '', 'volume_id': '8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'serial': '8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'resources' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Object Instance<ed271afb-bdb0-418f-b759-ad86ea0a79a0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'numa_topology' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Object Instance<ed271afb-bdb0-418f-b759-ad86ea0a79a0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:46 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:37:46 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.objects.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Object Instance<ed271afb-bdb0-418f-b759-ad86ea0a79a0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOLRqeJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:37:46 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:46 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:37:46 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:37:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5218b73-a54c-457c-aea1-95e4fd9cb10a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EOLRqeJV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 16:37:46 user nova-compute[74048]: node.name = iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:37:46 user nova-compute[74048]: node.tpgt = -1
Oct 25 16:37:46 user nova-compute[74048]: node.startup = automatic
Oct 25 16:37:46 user nova-compute[74048]: node.leading_login = No
Oct 25 16:37:46 user nova-compute[74048]: iface.iscsi_ifacename = default
Oct 25 16:37:46 user nova-compute[74048]: iface.net_ifacename = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.ipaddress = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.prefix_len = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.hwaddress = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.transport_name = tcp
Oct 25 16:37:46 user nova-compute[74048]: iface.initiatorname = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.vlan_id = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.vlan_priority = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.vlan_state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.iface_num = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.mtu = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.port = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.bootproto = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.subnet_mask = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.gateway = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_alt_client_id = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_dns = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_learn_iqn = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_vendor_id_state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_vendor_id = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.dhcp_slp_da = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.fragmentation = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.gratuitous_arp = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.incoming_forwarding = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.tos_state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.tos = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.ttl = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.delayed_ack = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.tcp_nagle = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.tcp_wsf_state = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.tcp_wsf = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.tcp_timer_scale = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.tcp_timestamp = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.redirect = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.def_task_mgmt_timeout = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.header_digest = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.data_digest = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.immediate_data = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.initial_r2t = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.data_seq_inorder = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.data_pdu_inorder = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.erl = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.max_receive_data_len = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.first_burst_len = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.max_outstanding_r2t = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.max_burst_len = 0
Oct 25 16:37:46 user nova-compute[74048]: iface.chap_auth = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.bidi_chap = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.strict_login_compliance = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.discovery_auth = <empty>
Oct 25 16:37:46 user nova-compute[74048]: iface.discovery_logout = <empty>
Oct 25 16:37:46 user nova-compute[74048]: node.discovery_address = <empty>
Oct 25 16:37:46 user nova-compute[74048]: node.discovery_port = 0
Oct 25 16:37:46 user nova-compute[74048]: node.discovery_type = static
Oct 25 16:37:46 user nova-compute[74048]: node.session.initial_cmdsn = 0
Oct 25 16:37:46 user nova-compute[74048]: node.session.initial_login_retry_max = 8
Oct 25 16:37:46 user nova-compute[74048]: node.session.xmit_thread_priority = -20
Oct 25 16:37:46 user nova-compute[74048]: node.session.cmds_max = 128
Oct 25 16:37:46 user nova-compute[74048]: node.session.queue_depth = 32
Oct 25 16:37:46 user nova-compute[74048]: node.session.nr_sessions = 1
Oct 25 16:37:46 user nova-compute[74048]: node.session.auth.authmethod = CHAP
Oct 25 16:37:46 user nova-compute[74048]: node.session.auth.username = EOLRqeJV
Oct 25 16:37:46 user nova-compute[74048]: node.session.auth.password = ***
Oct 25 16:37:46 user nova-compute[74048]: node.session.auth.username_in = <empty>
Oct 25 16:37:46 user nova-compute[74048]: node.session.auth.password_in = <empty>
Oct 25 16:37:46 user nova-compute[74048]: node.session.auth.chap_algs = MD5
Oct 25 16:37:46 user nova-compute[74048]: node.session.timeo.replacement_timeout = 120
Oct 25 16:37:46 user nova-compute[74048]: node.session.err_timeo.abort_timeout = 15
Oct 25 16:37:46 user nova-compute[74048]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 16:37:46 user nova-compute[74048]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 16:37:46 user nova-compute[74048]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.FastAbort = Yes
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.InitialR2T = No
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.ImmediateData = Yes
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.MaxConnections = 1
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 16:37:46 user nova-compute[74048]: node.session.iscsi.ERL = 0
Oct 25 16:37:46 user nova-compute[74048]: node.session.scan = manual
Oct 25 16:37:46 user nova-compute[74048]: node.session.reopen_max = 0
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].address = 172.16.0.220
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].port = 3260
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].startup = manual
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].tcp.window_size = 524288
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].tcp.type_of_service = 0
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].timeo.logout_timeout = 15
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].timeo.login_timeout = 15
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].timeo.auth_timeout = 45
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].iscsi.DataDigest = None
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].iscsi.IFMarker = No
Oct 25 16:37:46 user nova-compute[74048]: node.conn[0].iscsi.OFMarker = No
Oct 25 16:37:46 user nova-compute[74048]: # END RECORD
Oct 25 16:37:46 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf312da7-4964-4d10-9179-d99da23cddbe]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147b7b4-43df-4589-a7f1-8eb614f02847]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOLRqeJV {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.network.neutron [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updated VIF entry in instance network info cache for port b225761b-69af-459c-ad4e-8901ba049969. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.network.neutron [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOLRqeJV" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f5cf4-2173-4f67-8784-a499017586ce]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOLRqeJV'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-982bcc66-99c0-4ee3-b79d-cbcd6bd554a4 req-6e3d2fb7-d112-4fe9-89ca-a45e79703763 service nova] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea77a7b-9c8b-4d3c-a48f-ceb119d1d404]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d009fa-a26e-4d23-a50a-b389d36829db]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:37:46 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] HCTL ('39', '0', '0', 0) found on session 30 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd15a4c-01e7-4994-a9a1-300d86349482]: (4, ('0 0 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Searching for a device in session 30 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOLRqeJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.319s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] <== connect_volume: return (321ms) {'type': 'block', 'scsi_wwn': '23333363039303464', 'path': '/dev/sdh'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:37:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333363039303464', 'path': '/dev/sdh'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-385805206',display_name='tempest-ServerStableDeviceRescueTest-server-385805206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-385805206',id=22,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsc1tXpqwtR2rS24hEi1/EO3kDqyp7qx2H7g98JNtlfkpRqSHHwild/rwLwUnnYeQsqbDKMA/Li2sJWTYVskmur2vnztyca6Jo0k0m6IPCIdx7QjAhjvrW4va6gh3s15A==',key_name='tempest-keypair-1484637459',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a44a4b9a261c4765901e177879113b75',ramdisk_id='',reservation_id='r-wskb0uet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-16526362',owner_user_name='tempest-ServerStableDeviceRescueTest-16526362-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cca46ca1142e7b9755e80e76e853e',uuid=ed271afb-bdb0-418f-b759-ad86ea0a79a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "vif_mac": "fa:16:3e:42:51:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converting VIF {"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "vif_mac": "fa:16:3e:42:51:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'pci_devices' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.objects.base [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Object Instance<ed271afb-bdb0-418f-b759-ad86ea0a79a0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:37:47 user nova-compute[74048]:   <uuid>ed271afb-bdb0-418f-b759-ad86ea0a79a0</uuid>
Oct 25 16:37:47 user nova-compute[74048]:   <name>instance-00000016</name>
Oct 25 16:37:47 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:37:47 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:37:47 user nova-compute[74048]:   <metadata>
Oct 25 16:37:47 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:37:47 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:37:47 user nova-compute[74048]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-385805206</nova:name>
Oct 25 16:37:47 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:37:46</nova:creationTime>
Oct 25 16:37:47 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:37:47 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:37:47 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:37:47 user nova-compute[74048]:       <nova:owner>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:user uuid="ce6cca46ca1142e7b9755e80e76e853e">tempest-ServerStableDeviceRescueTest-16526362-project-member</nova:user>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:project uuid="a44a4b9a261c4765901e177879113b75">tempest-ServerStableDeviceRescueTest-16526362</nova:project>
Oct 25 16:37:47 user nova-compute[74048]:       </nova:owner>
Oct 25 16:37:47 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:37:47 user nova-compute[74048]:       <nova:ports>
Oct 25 16:37:47 user nova-compute[74048]:         <nova:port uuid="a87afd20-35e1-40f8-81e2-ad3964a04feb">
Oct 25 16:37:47 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:37:47 user nova-compute[74048]:         </nova:port>
Oct 25 16:37:47 user nova-compute[74048]:       </nova:ports>
Oct 25 16:37:47 user nova-compute[74048]:     </nova:instance>
Oct 25 16:37:47 user nova-compute[74048]:   </metadata>
Oct 25 16:37:47 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:37:47 user nova-compute[74048]:     <system>
Oct 25 16:37:47 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:37:47 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:37:47 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:37:47 user nova-compute[74048]:       <entry name="serial">ed271afb-bdb0-418f-b759-ad86ea0a79a0</entry>
Oct 25 16:37:47 user nova-compute[74048]:       <entry name="uuid">ed271afb-bdb0-418f-b759-ad86ea0a79a0</entry>
Oct 25 16:37:47 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:37:47 user nova-compute[74048]:     </system>
Oct 25 16:37:47 user nova-compute[74048]:   </sysinfo>
Oct 25 16:37:47 user nova-compute[74048]:   <os>
Oct 25 16:37:47 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:37:47 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:37:47 user nova-compute[74048]:   </os>
Oct 25 16:37:47 user nova-compute[74048]:   <features>
Oct 25 16:37:47 user nova-compute[74048]:     <acpi/>
Oct 25 16:37:47 user nova-compute[74048]:     <apic/>
Oct 25 16:37:47 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:37:47 user nova-compute[74048]:   </features>
Oct 25 16:37:47 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:37:47 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:37:47 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:37:47 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:37:47 user nova-compute[74048]:   </clock>
Oct 25 16:37:47 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:37:47 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:37:47 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:37:47 user nova-compute[74048]:   </cpu>
Oct 25 16:37:47 user nova-compute[74048]:   <devices>
Oct 25 16:37:47 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:37:47 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:37:47 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk"/>
Oct 25 16:37:47 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:37:47 user nova-compute[74048]:     </disk>
Oct 25 16:37:47 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:37:47 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:47 user nova-compute[74048]:       <source dev="/dev/sdh"/>
Oct 25 16:37:47 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:37:47 user nova-compute[74048]:       <serial>8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0</serial>
Oct 25 16:37:47 user nova-compute[74048]:     </disk>
Oct 25 16:37:47 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:37:47 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:37:47 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue"/>
Oct 25 16:37:47 user nova-compute[74048]:       <target dev="vdc" bus="virtio"/>
Oct 25 16:37:47 user nova-compute[74048]:       <boot order="1"/>
Oct 25 16:37:47 user nova-compute[74048]:     </disk>
Oct 25 16:37:47 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:37:47 user nova-compute[74048]:       <mac address="fa:16:3e:42:51:6d"/>
Oct 25 16:37:47 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:37:47 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:37:47 user nova-compute[74048]:       <target dev="tapa87afd20-35"/>
Oct 25 16:37:47 user nova-compute[74048]:     </interface>
Oct 25 16:37:47 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:37:47 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/console.log" append="off"/>
Oct 25 16:37:47 user nova-compute[74048]:     </serial>
Oct 25 16:37:47 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:37:47 user nova-compute[74048]:     <video>
Oct 25 16:37:47 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:37:47 user nova-compute[74048]:     </video>
Oct 25 16:37:47 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:37:47 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:37:47 user nova-compute[74048]:     </rng>
Oct 25 16:37:47 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:37:47 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:37:47 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:37:47 user nova-compute[74048]:     </memballoon>
Oct 25 16:37:47 user nova-compute[74048]:   </devices>
Oct 25 16:37:47 user nova-compute[74048]: </domain>
Oct 25 16:37:47 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:37:47 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance destroyed successfully.
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] No VIF found with MAC fa:16:3e:42:51:6d, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-9a47043c-a783-406f-9fad-638a368383af req-ae4921b9-deac-41c8-8290-ed25dfb71882 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9a47043c-a783-406f-9fad-638a368383af req-ae4921b9-deac-41c8-8290-ed25dfb71882 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9a47043c-a783-406f-9fad-638a368383af req-ae4921b9-deac-41c8-8290-ed25dfb71882 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9a47043c-a783-406f-9fad-638a368383af req-ae4921b9-deac-41c8-8290-ed25dfb71882 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-9a47043c-a783-406f-9fad-638a368383af req-ae4921b9-deac-41c8-8290-ed25dfb71882 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:49 user nova-compute[74048]: WARNING nova.compute.manager [req-9a47043c-a783-406f-9fad-638a368383af req-ae4921b9-deac-41c8-8290-ed25dfb71882 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state active and task_state rescuing.
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:50 user nova-compute[74048]: INFO nova.compute.manager [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Detaching volume 7a32bf78-dc59-4c78-ab85-776a570d7e6f
Oct 25 16:37:50 user nova-compute[74048]: INFO nova.virt.block_device [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Attempting to driver detach volume 7a32bf78-dc59-4c78-ab85-776a570d7e6f from mountpoint /dev/vdc
Oct 25 16:37:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Attempting to detach device vdc from instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:37:50 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:50 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:37:50 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 16:37:50 user nova-compute[74048]:   <serial>7a32bf78-dc59-4c78-ab85-776a570d7e6f</serial>
Oct 25 16:37:50 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 16:37:50 user nova-compute[74048]: </disk>
Oct 25 16:37:50 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:50 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully detached device vdc from instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac from the persistent domain config.
Oct 25 16:37:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:37:50 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:37:50 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:37:50 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 16:37:50 user nova-compute[74048]:   <serial>7a32bf78-dc59-4c78-ab85-776a570d7e6f</serial>
Oct 25 16:37:50 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 16:37:50 user nova-compute[74048]: </disk>
Oct 25 16:37:50 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-fdff4d7b-a1bd-41a2-9536-f270b1aef676 req-74ce7030-922e-4224-bdaa-fc184397c26a service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fdff4d7b-a1bd-41a2-9536-f270b1aef676 req-74ce7030-922e-4224-bdaa-fc184397c26a service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fdff4d7b-a1bd-41a2-9536-f270b1aef676 req-74ce7030-922e-4224-bdaa-fc184397c26a service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fdff4d7b-a1bd-41a2-9536-f270b1aef676 req-74ce7030-922e-4224-bdaa-fc184397c26a service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-fdff4d7b-a1bd-41a2-9536-f270b1aef676 req-74ce7030-922e-4224-bdaa-fc184397c26a service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:37:51 user nova-compute[74048]: WARNING nova.compute.manager [req-fdff4d7b-a1bd-41a2-9536-f270b1aef676 req-74ce7030-922e-4224-bdaa-fc184397c26a service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state active and task_state rescuing.
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b3bc0749-0ddc-4813-ba69-298daa8c1fae tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:37:52 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:37:52 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=25.046428680419922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 105119ce-b27f-41a7-b466-2f6b1ca03077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:37:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing instance network info cache due to event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:37:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updated VIF entry in instance network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fecd890a-2fdf-44f3-be0c-100f9a1dc80f req-767aabf9-87ea-4754-9fe1-713c737bb425 service nova] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing instance network info cache due to event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:37:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:37:55 user nova-compute[74048]: DEBUG nova.network.neutron [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updated VIF entry in instance network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:37:55 user nova-compute[74048]: DEBUG nova.network.neutron [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:37:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-79fd2ba9-10dd-40bc-a84f-ccf1f10c60b3 req-d6b89572-2dc8-4fbc-ad17-6c51fb0a4c7d service nova] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:37:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:37:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:05 user nova-compute[74048]: INFO nova.compute.manager [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Rebooting instance
Oct 25 16:38:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:38:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:38:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:38:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-69e3f20a-9782-4253-8eb0-67b53696b580 req-95cdb4a1-897a-4bfd-965e-be034a6c247f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-unplugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-69e3f20a-9782-4253-8eb0-67b53696b580 req-95cdb4a1-897a-4bfd-965e-be034a6c247f service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-69e3f20a-9782-4253-8eb0-67b53696b580 req-95cdb4a1-897a-4bfd-965e-be034a6c247f service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-69e3f20a-9782-4253-8eb0-67b53696b580 req-95cdb4a1-897a-4bfd-965e-be034a6c247f service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-69e3f20a-9782-4253-8eb0-67b53696b580 req-95cdb4a1-897a-4bfd-965e-be034a6c247f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-unplugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:06 user nova-compute[74048]: WARNING nova.compute.manager [req-69e3f20a-9782-4253-8eb0-67b53696b580 req-95cdb4a1-897a-4bfd-965e-be034a6c247f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-unplugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state active and task_state reboot_started_hard.
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance destroyed successfully.
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'resources' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1189844784',display_name='tempest-TestMinimumBasicScenario-server-1189844784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1189844784',id=24,image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWkaTm34IrrFgglBSk7gV/mazK3/QcVgVulSRYqYR4hz9wDbcdq1lllwiVe12fLxOWZ7RAIQTAv2Q1uscbN13y9VKwS0p/aJeGfPI6k23T/gHdXgomJF4gkR+6cXP8plA==',key_name='tempest-TestMinimumBasicScenario-91951899',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-l76sfr2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:38:06Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=af48ff38-5eaa-4885-839d-bd8b8d6d4de4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap963fe763-7f, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=097b2501-d931-4b1b-9efb-a6cca88c6560) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:38:07 user nova-compute[74048]: INFO os_vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f')
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:38:07 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d817dd1-f9d6-4ca5-bbdf-26e5cabac6d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:38:07 user nova-compute[74048]: No targets found.
Oct 25 16:38:07 user nova-compute[74048]: iSNS:
Oct 25 16:38:07 user nova-compute[74048]: No targets found.
Oct 25 16:38:07 user nova-compute[74048]: STATIC:
Oct 25 16:38:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:38:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f
Oct 25 16:38:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:38:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:38:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:38:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:07 user nova-compute[74048]: FIRMWARE:
Oct 25 16:38:07 user nova-compute[74048]: No targets found.
Oct 25 16:38:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:38:07 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:38:07 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b47080-7727-4b96-a69a-e70aa25d8412]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8527fbf-d77f-49bb-9e39-4f8fab972bbb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840531900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084'): ({'sdg'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Removing single pathed devices sdg {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcf9a96-eea4-4689-9361-551ee74c90a8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e8c77-eefb-45b6-bab4-8f1de89b7db5]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flushing IO for device /dev/sdg {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c86a2-7a6e-4670-9606-ea98970ade06]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3603ea-2373-44ad-92d1-85a6104597fc]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] SCSI volumes sdg have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689e75e-9a28-48ad-a11b-2abca66ba256]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd9ca3-74b6-43e9-b69d-6e92386d1ed4]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]
Oct 25 16:38:07 user nova-compute[74048]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.
Oct 25 16:38:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a0ef2-074a-4a2f-ba7a-e73b77588046]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== disconnect_volume: return (319ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Start _get_guest_xml network_info=[{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': 'cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'b4d65de8-b8e3-441d-ae24-11ee84241aa9', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'af48ff38-5eaa-4885-839d-bd8b8d6d4de4', 'attached_at': '', 'detached_at': '', 'volume_id': '7871e2f8-746b-4bed-b5f6-c35104c08084', 'serial': '7871e2f8-746b-4bed-b5f6-c35104c08084'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:38:07 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:38:07 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'vcpu_model' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.objects.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Object Instance<af48ff38-5eaa-4885-839d-bd8b8d6d4de4> lazy-loaded attributes: resources,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:38:07 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:38:07 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:38:07 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ef7576-ff07-4fa4-b6cb-0cbaad196523]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:38:07 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba4c24-d106-4c3a-ba40-8c9f37a5161d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084] added
Oct 25 16:38:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c395aa43-4024-4364-9174-f5c2dc6c2787]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:08 user nova-compute[74048]: INFO nova.compute.manager [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Terminating instance
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b42c17-83d0-4f2e-b6a3-7c348dc8a2b2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igkAQqRC {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v igkAQqRC" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ac8f14-aef5-4b37-9665-a2b499eda7e8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'igkAQqRC'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae3b87e-b91d-4148-82a8-ac45efa70766]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b568788-a10e-40fd-ab92-da53079534e1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5a294-47ee-42de-a47d-2a0be5ece6ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]
Oct 25 16:38:08 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.
Oct 25 16:38:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d1991-f256-4d31-8256-1f64274797c0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d41fa-15e2-4088-bcd6-9c8de0092917]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:38:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.619s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[220134a2-0e3d-4c83-80eb-b70f5fced4f8]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e972e652-74c7-4f3b-b9bd-6061f1ecd366 req-fbf89a7f-c22b-45a6-b4d2-743afc869173 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-vif-unplugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e972e652-74c7-4f3b-b9bd-6061f1ecd366 req-fbf89a7f-c22b-45a6-b4d2-743afc869173 service nova] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e972e652-74c7-4f3b-b9bd-6061f1ecd366 req-fbf89a7f-c22b-45a6-b4d2-743afc869173 service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e972e652-74c7-4f3b-b9bd-6061f1ecd366 req-fbf89a7f-c22b-45a6-b4d2-743afc869173 service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e972e652-74c7-4f3b-b9bd-6061f1ecd366 req-fbf89a7f-c22b-45a6-b4d2-743afc869173 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] No waiting events found dispatching network-vif-unplugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e972e652-74c7-4f3b-b9bd-6061f1ecd366 req-fbf89a7f-c22b-45a6-b4d2-743afc869173 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-vif-unplugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-169f90b6-9312-4200-af26-9b42b00b5bba req-a62215be-976a-4a6c-aa5d-357822ad08c2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-169f90b6-9312-4200-af26-9b42b00b5bba req-a62215be-976a-4a6c-aa5d-357822ad08c2 service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-169f90b6-9312-4200-af26-9b42b00b5bba req-a62215be-976a-4a6c-aa5d-357822ad08c2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-169f90b6-9312-4200-af26-9b42b00b5bba req-a62215be-976a-4a6c-aa5d-357822ad08c2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-169f90b6-9312-4200-af26-9b42b00b5bba req-a62215be-976a-4a6c-aa5d-357822ad08c2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:08 user nova-compute[74048]: WARNING nova.compute.manager [req-169f90b6-9312-4200-af26-9b42b00b5bba req-a62215be-976a-4a6c-aa5d-357822ad08c2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state active and task_state reboot_started_hard.
Oct 25 16:38:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Instance destroyed successfully.
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.objects.instance [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'resources' on Instance uuid 105119ce-b27f-41a7-b466-2f6b1ca03077 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1499400529',display_name='tempest-AttachVolumeNegativeTest-server-1499400529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1499400529',id=23,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu+Vb9olSog0NENb0JydaT8Ro8ry7jbASxsp12gjj4nVboFaid+URjU88lMGSDro9+QjF5QlFOwvVX82eOItn+tza4crMOJsbxkTWr47bBvYsty+AErLs22W32H+xvR/g==',key_name='tempest-keypair-114412920',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-vb10w5yr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=105119ce-b27f-41a7-b466-2f6b1ca03077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "address": "fa:16:3e:a4:ed:c2", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a1be3f-29", "ovs_interfaceid": "12a1be3f-29dd-4dfc-8be7-77df08c2c23e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG os_vif [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12a1be3f-29, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ecb77af-bea2-4ba5-8a69-021bc7227f05) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:38:08 user nova-compute[74048]: INFO os_vif [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ed:c2,bridge_name='br-int',has_traffic_filtering=True,id=12a1be3f-29dd-4dfc-8be7-77df08c2c23e,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a1be3f-29')
Oct 25 16:38:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Deleting instance files /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077_del
Oct 25 16:38:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Deletion of /opt/stack/data/nova/instances/105119ce-b27f-41a7-b466-2f6b1ca03077_del complete
Oct 25 16:38:08 user nova-compute[74048]: INFO nova.compute.manager [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 16:38:08 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:38:08 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.659s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== connect_volume: return (1662ms) {'type': 'block', 'scsi_wwn': '23066636264326135', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066636264326135', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1189844784',display_name='tempest-TestMinimumBasicScenario-server-1189844784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1189844784',id=24,image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWkaTm34IrrFgglBSk7gV/mazK3/QcVgVulSRYqYR4hz9wDbcdq1lllwiVe12fLxOWZ7RAIQTAv2Q1uscbN13y9VKwS0p/aJeGfPI6k23T/gHdXgomJF4gkR+6cXP8plA==',key_name='tempest-TestMinimumBasicScenario-91951899',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-l76sfr2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:38:06Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=af48ff38-5eaa-4885-839d-bd8b8d6d4de4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'pci_devices' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.objects.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Object Instance<af48ff38-5eaa-4885-839d-bd8b8d6d4de4> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:38:09 user nova-compute[74048]:   <uuid>af48ff38-5eaa-4885-839d-bd8b8d6d4de4</uuid>
Oct 25 16:38:09 user nova-compute[74048]:   <name>instance-00000018</name>
Oct 25 16:38:09 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:38:09 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:38:09 user nova-compute[74048]:   <metadata>
Oct 25 16:38:09 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:38:09 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:38:09 user nova-compute[74048]:       <nova:name>tempest-TestMinimumBasicScenario-server-1189844784</nova:name>
Oct 25 16:38:09 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:38:07</nova:creationTime>
Oct 25 16:38:09 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:38:09 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:38:09 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:38:09 user nova-compute[74048]:       <nova:owner>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:user uuid="50155e9b8e7d472882d4fcd6d84acfd1">tempest-TestMinimumBasicScenario-323418568-project-member</nova:user>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:project uuid="242b649ca85c446d84b89b770c703c47">tempest-TestMinimumBasicScenario-323418568</nova:project>
Oct 25 16:38:09 user nova-compute[74048]:       </nova:owner>
Oct 25 16:38:09 user nova-compute[74048]:       <nova:root type="image" uuid="cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70"/>
Oct 25 16:38:09 user nova-compute[74048]:       <nova:ports>
Oct 25 16:38:09 user nova-compute[74048]:         <nova:port uuid="963fe763-7fca-4fe8-bf4d-a252959c94fd">
Oct 25 16:38:09 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:38:09 user nova-compute[74048]:         </nova:port>
Oct 25 16:38:09 user nova-compute[74048]:       </nova:ports>
Oct 25 16:38:09 user nova-compute[74048]:     </nova:instance>
Oct 25 16:38:09 user nova-compute[74048]:   </metadata>
Oct 25 16:38:09 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:38:09 user nova-compute[74048]:     <system>
Oct 25 16:38:09 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:38:09 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:38:09 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:38:09 user nova-compute[74048]:       <entry name="serial">af48ff38-5eaa-4885-839d-bd8b8d6d4de4</entry>
Oct 25 16:38:09 user nova-compute[74048]:       <entry name="uuid">af48ff38-5eaa-4885-839d-bd8b8d6d4de4</entry>
Oct 25 16:38:09 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:38:09 user nova-compute[74048]:     </system>
Oct 25 16:38:09 user nova-compute[74048]:   </sysinfo>
Oct 25 16:38:09 user nova-compute[74048]:   <os>
Oct 25 16:38:09 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:38:09 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:38:09 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:38:09 user nova-compute[74048]:   </os>
Oct 25 16:38:09 user nova-compute[74048]:   <features>
Oct 25 16:38:09 user nova-compute[74048]:     <acpi/>
Oct 25 16:38:09 user nova-compute[74048]:     <apic/>
Oct 25 16:38:09 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:38:09 user nova-compute[74048]:   </features>
Oct 25 16:38:09 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:38:09 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:38:09 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:38:09 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:38:09 user nova-compute[74048]:   </clock>
Oct 25 16:38:09 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:38:09 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:38:09 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:38:09 user nova-compute[74048]:   </cpu>
Oct 25 16:38:09 user nova-compute[74048]:   <devices>
Oct 25 16:38:09 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:38:09 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:38:09 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk"/>
Oct 25 16:38:09 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:38:09 user nova-compute[74048]:     </disk>
Oct 25 16:38:09 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:38:09 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:38:09 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:38:09 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:38:09 user nova-compute[74048]:       <serial>7871e2f8-746b-4bed-b5f6-c35104c08084</serial>
Oct 25 16:38:09 user nova-compute[74048]:     </disk>
Oct 25 16:38:09 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:38:09 user nova-compute[74048]:       <mac address="fa:16:3e:cc:19:90"/>
Oct 25 16:38:09 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:38:09 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:38:09 user nova-compute[74048]:       <target dev="tap963fe763-7f"/>
Oct 25 16:38:09 user nova-compute[74048]:     </interface>
Oct 25 16:38:09 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:38:09 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/console.log" append="off"/>
Oct 25 16:38:09 user nova-compute[74048]:     </serial>
Oct 25 16:38:09 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:38:09 user nova-compute[74048]:     <video>
Oct 25 16:38:09 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:38:09 user nova-compute[74048]:     </video>
Oct 25 16:38:09 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:38:09 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:38:09 user nova-compute[74048]:     </rng>
Oct 25 16:38:09 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:38:09 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:38:09 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:38:09 user nova-compute[74048]:     </memballoon>
Oct 25 16:38:09 user nova-compute[74048]:   </devices>
Oct 25 16:38:09 user nova-compute[74048]: </domain>
Oct 25 16:38:09 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:09 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Took 0.81 seconds to deallocate network for instance.
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'trusted_certs' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.objects.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Object Instance<af48ff38-5eaa-4885-839d-bd8b8d6d4de4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:38:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Cannot resize image /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'migration_context' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.objects.base [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Object Instance<af48ff38-5eaa-4885-839d-bd8b8d6d4de4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1189844784',display_name='tempest-TestMinimumBasicScenario-server-1189844784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1189844784',id=24,image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWkaTm34IrrFgglBSk7gV/mazK3/QcVgVulSRYqYR4hz9wDbcdq1lllwiVe12fLxOWZ7RAIQTAv2Q1uscbN13y9VKwS0p/aJeGfPI6k23T/gHdXgomJF4gkR+6cXP8plA==',key_name='tempest-TestMinimumBasicScenario-91951899',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-l76sfr2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:38:06Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=af48ff38-5eaa-4885-839d-bd8b8d6d4de4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2565f84a-147e-5bf6-bbfd-2ed9b075aca7', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap963fe763-7f, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap963fe763-7f, col_values=(('qos', UUID('9e35562d-7f9c-4642-bff2-6f7c3b31e8e2')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap963fe763-7f, col_values=(('external_ids', {'iface-id': '963fe763-7fca-4fe8-bf4d-a252959c94fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:19:90', 'vm-uuid': 'af48ff38-5eaa-4885-839d-bd8b8d6d4de4'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: INFO os_vif [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f')
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:10 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Deleted allocations for instance 105119ce-b27f-41a7-b466-2f6b1ca03077
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc54baed-4d5e-4d14-bcf0-101197869796 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] Acquiring lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] Lock "105119ce-b27f-41a7-b466-2f6b1ca03077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] No waiting events found dispatching network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:10 user nova-compute[74048]: WARNING nova.compute.manager [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received unexpected event network-vif-plugged-12a1be3f-29dd-4dfc-8be7-77df08c2c23e for instance with vm_state deleted and task_state None.
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-7b34f8d6-8e7a-465a-ae17-c00931747efb req-359b54f4-9f52-454c-ae56-805e874743c6 service nova] [instance: 105119ce-b27f-41a7-b466-2f6b1ca03077] Received event network-vif-deleted-12a1be3f-29dd-4dfc-8be7-77df08c2c23e {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac is timed out.
Oct 25 16:38:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully detached device vdc from instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac from the live domain config.
Oct 25 16:38:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbAjuwQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:38:10 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[611c2b7b-a19c-4cff-9c00-e4a4b3426a93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:38:10 user nova-compute[74048]: No targets found.
Oct 25 16:38:10 user nova-compute[74048]: iSNS:
Oct 25 16:38:10 user nova-compute[74048]: No targets found.
Oct 25 16:38:10 user nova-compute[74048]: STATIC:
Oct 25 16:38:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:38:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f
Oct 25 16:38:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:38:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:38:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:38:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:38:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:38:10 user nova-compute[74048]: FIRMWARE:
Oct 25 16:38:10 user nova-compute[74048]: No targets found.
Oct 25 16:38:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:38:10 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:38:10 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14eb03-3705-46a1-9cc0-e097059d1849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c319f9-df44-4a2e-86e5-019dd8711e23]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:38:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850377d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f'): ({'sde'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Removing single pathed devices sde {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3b8abd-2676-439f-97d0-9f4dc2a170e8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[463693dd-48c8-45e7-8927-e52c2f5ac542]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flushing IO for device /dev/sde {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[597480da-25da-4b26-bfb1-9ccb79747885]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c7b98d-3e64-44b1-a824-308fc6ef7972]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b62d7-f162-439a-b505-74c87e312673]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea066229-0261-4863-a963-568573970283]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260]
Oct 25 16:38:11 user nova-compute[74048]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f, portal: 172.16.0.220,3260] successful.
Oct 25 16:38:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a32bf78-dc59-4c78-ab85-776a570d7e6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb95a6c8-73dc-4a80-8db2-3a98b3068885]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] <== disconnect_volume: return (328ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'flavor' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3c2b75b4-d637-4e4d-8818-3206d2bb5c89 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:38:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance rebooted successfully.
Oct 25 16:38:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:38:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc167d61-a505-4ba3-8820-bacbf4a8f4b0 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.410s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-6fab16c7-b99b-4262-b32d-5cbacfee8e47 req-59f3a845-c80b-4dd1-991a-b92d4c0e3aff service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6fab16c7-b99b-4262-b32d-5cbacfee8e47 req-59f3a845-c80b-4dd1-991a-b92d4c0e3aff service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6fab16c7-b99b-4262-b32d-5cbacfee8e47 req-59f3a845-c80b-4dd1-991a-b92d4c0e3aff service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6fab16c7-b99b-4262-b32d-5cbacfee8e47 req-59f3a845-c80b-4dd1-991a-b92d4c0e3aff service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-6fab16c7-b99b-4262-b32d-5cbacfee8e47 req-59f3a845-c80b-4dd1-991a-b92d4c0e3aff service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:14 user nova-compute[74048]: WARNING nova.compute.manager [req-6fab16c7-b99b-4262-b32d-5cbacfee8e47 req-59f3a845-c80b-4dd1-991a-b92d4c0e3aff service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state active and task_state None.
Oct 25 16:38:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-6bb8f4ce-e8e8-40b2-827d-8aad929ae3ba req-fccd30f8-9965-416e-acb7-67b4e590bfb2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6bb8f4ce-e8e8-40b2-827d-8aad929ae3ba req-fccd30f8-9965-416e-acb7-67b4e590bfb2 service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6bb8f4ce-e8e8-40b2-827d-8aad929ae3ba req-fccd30f8-9965-416e-acb7-67b4e590bfb2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-6bb8f4ce-e8e8-40b2-827d-8aad929ae3ba req-fccd30f8-9965-416e-acb7-67b4e590bfb2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-6bb8f4ce-e8e8-40b2-827d-8aad929ae3ba req-fccd30f8-9965-416e-acb7-67b4e590bfb2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:16 user nova-compute[74048]: WARNING nova.compute.manager [req-6bb8f4ce-e8e8-40b2-827d-8aad929ae3ba req-fccd30f8-9965-416e-acb7-67b4e590bfb2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state active and task_state None.
Oct 25 16:38:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:37 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:38:39 user nova-compute[74048]: INFO nova.compute.claims [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Claim successful on node user
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.network.neutron [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:38:39 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:38:39 user nova-compute[74048]: INFO nova.virt.block_device [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Booting with volume snapshot cb75479f-aadb-45b5-a5dc-0ca8da643d7d at /dev/vda
Oct 25 16:38:39 user nova-compute[74048]: DEBUG nova.policy [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef034e25bba42e78a18c07c4e7ec3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2facb7bd1f4b47149df26f9494f180ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:40 user nova-compute[74048]: INFO nova.compute.manager [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Terminating instance
Oct 25 16:38:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG nova.network.neutron [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Successfully created port: 8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-3ff88690-e940-4737-bcd4-ab6caec8a792 req-edb9d6a3-f238-4531-bd6c-75bd9e0ae5f2 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-unplugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3ff88690-e940-4737-bcd4-ab6caec8a792 req-edb9d6a3-f238-4531-bd6c-75bd9e0ae5f2 service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3ff88690-e940-4737-bcd4-ab6caec8a792 req-edb9d6a3-f238-4531-bd6c-75bd9e0ae5f2 service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3ff88690-e940-4737-bcd4-ab6caec8a792 req-edb9d6a3-f238-4531-bd6c-75bd9e0ae5f2 service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-3ff88690-e940-4737-bcd4-ab6caec8a792 req-edb9d6a3-f238-4531-bd6c-75bd9e0ae5f2 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-unplugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-3ff88690-e940-4737-bcd4-ab6caec8a792 req-edb9d6a3-f238-4531-bd6c-75bd9e0ae5f2 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-unplugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:38:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Instance destroyed successfully.
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.objects.instance [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'resources' on Instance uuid 30783ca1-6eb2-4c19-907c-f4e84ca696ac {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-93929825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-93929825',id=18,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvvFjuGaODPDW3M0J8/43pwh8ovPqWKy/dy6XY1+h7DMUpnq2te7GFJeDZmlimngWhcsv+bxmsRq1r2zKhBX75jBabs+k3r1xodY2EuyVOk5Qy22mOGLVhxGqu212ChZA==',key_name='tempest-keypair-513469368',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-8ltesbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=30783ca1-6eb2-4c19-907c-f4e84ca696ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "1226b11a-beef-408e-b4b4-bf13383c8cde", "address": "fa:16:3e:d6:46:f8", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1226b11a-be", "ovs_interfaceid": "1226b11a-beef-408e-b4b4-bf13383c8cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG os_vif [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1226b11a-be, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=028df166-8c4a-4a80-9dfe-38dca6c79d60) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:41 user nova-compute[74048]: INFO os_vif [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:46:f8,bridge_name='br-int',has_traffic_filtering=True,id=1226b11a-beef-408e-b4b4-bf13383c8cde,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1226b11a-be')
Oct 25 16:38:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Deleting instance files /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac_del
Oct 25 16:38:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Deletion of /opt/stack/data/nova/instances/30783ca1-6eb2-4c19-907c-f4e84ca696ac_del complete
Oct 25 16:38:41 user nova-compute[74048]: INFO nova.compute.manager [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 16:38:41 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Successfully updated port: 8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "refresh_cache-cad6ec15-92ec-44f9-bb56-17620a43e847" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquired lock "refresh_cache-cad6ec15-92ec-44f9-bb56-17620a43e847" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:38:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:42 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Took 0.75 seconds to deallocate network for instance.
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-735938f3-1c83-4a82-a687-c4cb0ad3dbee req-184245b5-ef5d-4ef5-8518-316338505cd8 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-deleted-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:42 user nova-compute[74048]: INFO nova.compute.manager [req-735938f3-1c83-4a82-a687-c4cb0ad3dbee req-184245b5-ef5d-4ef5-8518-316338505cd8 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Neutron deleted interface 1226b11a-beef-408e-b4b4-bf13383c8cde; detaching it from the instance and deleting it from the info cache
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.network.neutron [req-735938f3-1c83-4a82-a687-c4cb0ad3dbee req-184245b5-ef5d-4ef5-8518-316338505cd8 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-735938f3-1c83-4a82-a687-c4cb0ad3dbee req-184245b5-ef5d-4ef5-8518-316338505cd8 service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Detach interface failed, port_id=1226b11a-beef-408e-b4b4-bf13383c8cde, reason: Instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Updating instance_info_cache with network_info: [{"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Releasing lock "refresh_cache-cad6ec15-92ec-44f9-bb56-17620a43e847" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Instance network_info: |[{"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:42 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Deleted allocations for instance 30783ca1-6eb2-4c19-907c-f4e84ca696ac
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-079ef472-de3c-4c17-8365-da9bffc388b6 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] Acquiring lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] Lock "30783ca1-6eb2-4c19-907c-f4e84ca696ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] No waiting events found dispatching network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:38:42 user nova-compute[74048]: WARNING nova.compute.manager [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: 30783ca1-6eb2-4c19-907c-f4e84ca696ac] Received unexpected event network-vif-plugged-1226b11a-beef-408e-b4b4-bf13383c8cde for instance with vm_state deleted and task_state None.
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-changed-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Refreshing instance network info cache due to event network-changed-8b28831f-48a0-4a0f-9697-857d854a22cc. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] Acquiring lock "refresh_cache-cad6ec15-92ec-44f9-bb56-17620a43e847" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] Acquired lock "refresh_cache-cad6ec15-92ec-44f9-bb56-17620a43e847" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:38:42 user nova-compute[74048]: DEBUG nova.network.neutron [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Refreshing network info cache for port 8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Updated VIF entry in instance network info cache for port 8b28831f-48a0-4a0f-9697-857d854a22cc. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Updating instance_info_cache with network_info: [{"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f57b0197-4756-4918-b954-c846348929a4 req-d3e608f9-7e82-4fec-b58f-ba6d9ab834be service nova] Releasing lock "refresh_cache-cad6ec15-92ec-44f9-bb56-17620a43e847" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:38:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG os_brick.utils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f4d89-c8a4-4180-82f9-c2a788286093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c014b882-b0df-4b23-8640-aba7eca18f1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ac0c3-3e0d-4c5b-8224-89197589ff4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1583ce-f034-4dfc-b905-37133e1f4679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:38:46 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:38:46 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[552acb6a-72ff-435a-995d-3058027072ab]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:38:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:38:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:38:46 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:38:46 user nova-compute[74048]: DEBUG os_brick.utils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:38:46 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Updating existing volume attachment record: 4f490656-306e-4e8b-9372-b5c2a302a118 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:38:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:38:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:38:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:38:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.086280822753906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance cad6ec15-92ec-44f9-bb56-17620a43e847 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:38:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:38:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:38:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:39:01 user nova-compute[74048]: INFO nova.compute.claims [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Claim successful on node user
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.network.neutron [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:39:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.policy [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c18414d5c9d7450ca96521eabe2a002d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add2dbb4f18f41b291725ab0073ebd37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:39:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Creating image(s)
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "/opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "/opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "/opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk 1073741824" returned: 0 in 0.054s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Successfully created port: 2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Cannot resize image /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Ensure instance console log exists: /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Successfully updated port: 2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquired lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-changed-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Refreshing instance network info cache due to event network-changed-2f612d84-7ced-4714-b58a-1cd940bf89e6. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] Acquiring lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updating instance_info_cache with network_info: [{"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Releasing lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Instance network_info: |[{"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] Acquired lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.neutron [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Refreshing network info cache for port 2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Start _get_guest_xml network_info=[{"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:39:04 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:04 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1291716055',display_name='tempest-AttachVolumeNegativeTest-server-1291716055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1291716055',id=28,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf7wPF0KKy+K8D9sWGcTgRAG2Oa1mi8IxfLLRnyO8mik8WS4TLuzd7BRCyv6rTyHBDba7bkdynjK3utphXEyGWfy0VN8SK89t8Mooje1Zb58G3c+0wnrhonLorhHUPYOA==',key_name='tempest-keypair-1713763456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-dvwd4h6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=761fc401-6c6a-4d05-91e5-875c54b27e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.objects.instance [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'pci_devices' on Instance uuid 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:39:04 user nova-compute[74048]:   <uuid>761fc401-6c6a-4d05-91e5-875c54b27e39</uuid>
Oct 25 16:39:04 user nova-compute[74048]:   <name>instance-0000001c</name>
Oct 25 16:39:04 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:39:04 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:39:04 user nova-compute[74048]:   <metadata>
Oct 25 16:39:04 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:39:04 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:39:04 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1291716055</nova:name>
Oct 25 16:39:04 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:39:04</nova:creationTime>
Oct 25 16:39:04 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:39:04 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:39:04 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:39:04 user nova-compute[74048]:       <nova:owner>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:user uuid="c18414d5c9d7450ca96521eabe2a002d">tempest-AttachVolumeNegativeTest-1660122620-project-member</nova:user>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:project uuid="add2dbb4f18f41b291725ab0073ebd37">tempest-AttachVolumeNegativeTest-1660122620</nova:project>
Oct 25 16:39:04 user nova-compute[74048]:       </nova:owner>
Oct 25 16:39:04 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:39:04 user nova-compute[74048]:       <nova:ports>
Oct 25 16:39:04 user nova-compute[74048]:         <nova:port uuid="2f612d84-7ced-4714-b58a-1cd940bf89e6">
Oct 25 16:39:04 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 16:39:04 user nova-compute[74048]:         </nova:port>
Oct 25 16:39:04 user nova-compute[74048]:       </nova:ports>
Oct 25 16:39:04 user nova-compute[74048]:     </nova:instance>
Oct 25 16:39:04 user nova-compute[74048]:   </metadata>
Oct 25 16:39:04 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:39:04 user nova-compute[74048]:     <system>
Oct 25 16:39:04 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:39:04 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:39:04 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:39:04 user nova-compute[74048]:       <entry name="serial">761fc401-6c6a-4d05-91e5-875c54b27e39</entry>
Oct 25 16:39:04 user nova-compute[74048]:       <entry name="uuid">761fc401-6c6a-4d05-91e5-875c54b27e39</entry>
Oct 25 16:39:04 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:39:04 user nova-compute[74048]:     </system>
Oct 25 16:39:04 user nova-compute[74048]:   </sysinfo>
Oct 25 16:39:04 user nova-compute[74048]:   <os>
Oct 25 16:39:04 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:39:04 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:39:04 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:39:04 user nova-compute[74048]:   </os>
Oct 25 16:39:04 user nova-compute[74048]:   <features>
Oct 25 16:39:04 user nova-compute[74048]:     <acpi/>
Oct 25 16:39:04 user nova-compute[74048]:     <apic/>
Oct 25 16:39:04 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:39:04 user nova-compute[74048]:   </features>
Oct 25 16:39:04 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:39:04 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:39:04 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:39:04 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:39:04 user nova-compute[74048]:   </clock>
Oct 25 16:39:04 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:39:04 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:39:04 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:39:04 user nova-compute[74048]:   </cpu>
Oct 25 16:39:04 user nova-compute[74048]:   <devices>
Oct 25 16:39:04 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:39:04 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:39:04 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk"/>
Oct 25 16:39:04 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:39:04 user nova-compute[74048]:     </disk>
Oct 25 16:39:04 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:39:04 user nova-compute[74048]:       <mac address="fa:16:3e:2f:e2:2a"/>
Oct 25 16:39:04 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:39:04 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:39:04 user nova-compute[74048]:       <target dev="tap2f612d84-7c"/>
Oct 25 16:39:04 user nova-compute[74048]:     </interface>
Oct 25 16:39:04 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:39:04 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/console.log" append="off"/>
Oct 25 16:39:04 user nova-compute[74048]:     </serial>
Oct 25 16:39:04 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:39:04 user nova-compute[74048]:     <video>
Oct 25 16:39:04 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:39:04 user nova-compute[74048]:     </video>
Oct 25 16:39:04 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:39:04 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:39:04 user nova-compute[74048]:     </rng>
Oct 25 16:39:04 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:39:04 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:39:04 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:39:04 user nova-compute[74048]:     </memballoon>
Oct 25 16:39:04 user nova-compute[74048]:   </devices>
Oct 25 16:39:04 user nova-compute[74048]: </domain>
Oct 25 16:39:04 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1291716055',display_name='tempest-AttachVolumeNegativeTest-server-1291716055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1291716055',id=28,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf7wPF0KKy+K8D9sWGcTgRAG2Oa1mi8IxfLLRnyO8mik8WS4TLuzd7BRCyv6rTyHBDba7bkdynjK3utphXEyGWfy0VN8SK89t8Mooje1Zb58G3c+0wnrhonLorhHUPYOA==',key_name='tempest-keypair-1713763456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-dvwd4h6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=761fc401-6c6a-4d05-91e5-875c54b27e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_vif [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab33ab49-6ff9-5bcf-a472-f3ee66bc8430', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f612d84-7c, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f612d84-7c, col_values=(('qos', UUID('175f66e4-005c-41a4-bb0a-4ed66b65eece')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f612d84-7c, col_values=(('external_ids', {'iface-id': '2f612d84-7ced-4714-b58a-1cd940bf89e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e2:2a', 'vm-uuid': '761fc401-6c6a-4d05-91e5-875c54b27e39'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:04 user nova-compute[74048]: INFO os_vif [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c')
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No VIF found with MAC fa:16:3e:2f:e2:2a, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:39:04 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Creating image(s)
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Ensure instance console log exists: /opt/stack/data/nova/instances/cad6ec15-92ec-44f9-bb56-17620a43e847/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Start _get_guest_xml network_info=[{"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '4f490656-306e-4e8b-9372-b5c2a302a118', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNtKyLIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cad6ec15-92ec-44f9-bb56-17620a43e847', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3d23225-f576-4bfd-92af-749b9ba40c90', 'serial': 'e3d23225-f576-4bfd-92af-749b9ba40c90'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:39:04 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:04 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNtKyLIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:39:04 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:39:04 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:39:04 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3349c-f77e-4452-b2dc-16304b433e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:39:04 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[766f3665-7629-437d-8349-bef87464b178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90] added
Oct 25 16:39:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b6e580-ea21-4212-9c0a-0bee2414991d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updated VIF entry in instance network info cache for port 2f612d84-7ced-4714-b58a-1cd940bf89e6. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updating instance_info_cache with network_info: [{"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1632c56-046e-40ed-b0a3-00f362b0796b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a16fe32-16f0-4cb4-a114-8fcd90dd81c6 req-f5e21448-45c0-49e5-9258-a11e76d43850 service nova] Releasing lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNtKyLIq {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gNtKyLIq" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca7bbe-265a-4c21-9723-f463458d3249]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gNtKyLIq'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bfdcd7-8860-482b-88f5-ae1ae899d6c1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9008462b-65af-471a-a144-a29cf578f045]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6739e9f-2347-49d0-ac55-22c04d5453bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260]
Oct 25 16:39:05 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260] successful.
Oct 25 16:39:05 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b69c8a-7d85-4971-8701-33f782e7d827]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e068dece-216a-4172-8f1f-a0afdc3bade9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:39:05 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a8120-4ce9-4d34-adc2-fccc80101e74]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:39:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNtKyLIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23033356433363636', 'path': '/dev/sde'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033356433363636', 'path': '/dev/sde'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-79ad68f9-be98-41d2-b530-094616022f54 req-f4dd3faa-e577-4424-9ae1-d5c8141590ed service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-79ad68f9-be98-41d2-b530-094616022f54 req-f4dd3faa-e577-4424-9ae1-d5c8141590ed service nova] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-79ad68f9-be98-41d2-b530-094616022f54 req-f4dd3faa-e577-4424-9ae1-d5c8141590ed service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-79ad68f9-be98-41d2-b530-094616022f54 req-f4dd3faa-e577-4424-9ae1-d5c8141590ed service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-79ad68f9-be98-41d2-b530-094616022f54 req-f4dd3faa-e577-4424-9ae1-d5c8141590ed service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] No waiting events found dispatching network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:06 user nova-compute[74048]: WARNING nova.compute.manager [req-79ad68f9-be98-41d2-b530-094616022f54 req-f4dd3faa-e577-4424-9ae1-d5c8141590ed service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received unexpected event network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 for instance with vm_state building and task_state spawning.
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:38:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712295321',display_name='tempest-TestVolumeBootPattern-server-1712295321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1712295321',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-10y5kelx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:38:40Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=cad6ec15-92ec-44f9-bb56-17620a43e847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.objects.instance [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'pci_devices' on Instance uuid cad6ec15-92ec-44f9-bb56-17620a43e847 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:39:06 user nova-compute[74048]:   <uuid>cad6ec15-92ec-44f9-bb56-17620a43e847</uuid>
Oct 25 16:39:06 user nova-compute[74048]:   <name>instance-0000001b</name>
Oct 25 16:39:06 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:39:06 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:39:06 user nova-compute[74048]:   <metadata>
Oct 25 16:39:06 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:39:06 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:39:06 user nova-compute[74048]:       <nova:name>tempest-TestVolumeBootPattern-server-1712295321</nova:name>
Oct 25 16:39:06 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:39:04</nova:creationTime>
Oct 25 16:39:06 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:39:06 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:39:06 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:39:06 user nova-compute[74048]:       <nova:owner>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:user uuid="0ef034e25bba42e78a18c07c4e7ec3b2">tempest-TestVolumeBootPattern-1454543820-project-member</nova:user>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:project uuid="2facb7bd1f4b47149df26f9494f180ae">tempest-TestVolumeBootPattern-1454543820</nova:project>
Oct 25 16:39:06 user nova-compute[74048]:       </nova:owner>
Oct 25 16:39:06 user nova-compute[74048]:       <nova:ports>
Oct 25 16:39:06 user nova-compute[74048]:         <nova:port uuid="8b28831f-48a0-4a0f-9697-857d854a22cc">
Oct 25 16:39:06 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:39:06 user nova-compute[74048]:         </nova:port>
Oct 25 16:39:06 user nova-compute[74048]:       </nova:ports>
Oct 25 16:39:06 user nova-compute[74048]:     </nova:instance>
Oct 25 16:39:06 user nova-compute[74048]:   </metadata>
Oct 25 16:39:06 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:39:06 user nova-compute[74048]:     <system>
Oct 25 16:39:06 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:39:06 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:39:06 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:39:06 user nova-compute[74048]:       <entry name="serial">cad6ec15-92ec-44f9-bb56-17620a43e847</entry>
Oct 25 16:39:06 user nova-compute[74048]:       <entry name="uuid">cad6ec15-92ec-44f9-bb56-17620a43e847</entry>
Oct 25 16:39:06 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:39:06 user nova-compute[74048]:     </system>
Oct 25 16:39:06 user nova-compute[74048]:   </sysinfo>
Oct 25 16:39:06 user nova-compute[74048]:   <os>
Oct 25 16:39:06 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:39:06 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:39:06 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:39:06 user nova-compute[74048]:   </os>
Oct 25 16:39:06 user nova-compute[74048]:   <features>
Oct 25 16:39:06 user nova-compute[74048]:     <acpi/>
Oct 25 16:39:06 user nova-compute[74048]:     <apic/>
Oct 25 16:39:06 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:39:06 user nova-compute[74048]:   </features>
Oct 25 16:39:06 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:39:06 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:39:06 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:39:06 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:39:06 user nova-compute[74048]:   </clock>
Oct 25 16:39:06 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:39:06 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:39:06 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:39:06 user nova-compute[74048]:   </cpu>
Oct 25 16:39:06 user nova-compute[74048]:   <devices>
Oct 25 16:39:06 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:39:06 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:39:06 user nova-compute[74048]:       <source dev="/dev/sde"/>
Oct 25 16:39:06 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:39:06 user nova-compute[74048]:       <serial>e3d23225-f576-4bfd-92af-749b9ba40c90</serial>
Oct 25 16:39:06 user nova-compute[74048]:     </disk>
Oct 25 16:39:06 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:39:06 user nova-compute[74048]:       <mac address="fa:16:3e:b1:47:fe"/>
Oct 25 16:39:06 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:39:06 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:39:06 user nova-compute[74048]:       <target dev="tap8b28831f-48"/>
Oct 25 16:39:06 user nova-compute[74048]:     </interface>
Oct 25 16:39:06 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:39:06 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/cad6ec15-92ec-44f9-bb56-17620a43e847/console.log" append="off"/>
Oct 25 16:39:06 user nova-compute[74048]:     </serial>
Oct 25 16:39:06 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:39:06 user nova-compute[74048]:     <video>
Oct 25 16:39:06 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:39:06 user nova-compute[74048]:     </video>
Oct 25 16:39:06 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:39:06 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:39:06 user nova-compute[74048]:     </rng>
Oct 25 16:39:06 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:39:06 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:39:06 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:39:06 user nova-compute[74048]:     </memballoon>
Oct 25 16:39:06 user nova-compute[74048]:   </devices>
Oct 25 16:39:06 user nova-compute[74048]: </domain>
Oct 25 16:39:06 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:38:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712295321',display_name='tempest-TestVolumeBootPattern-server-1712295321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1712295321',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-10y5kelx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:38:40Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=cad6ec15-92ec-44f9-bb56-17620a43e847,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG os_vif [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83a2d035-8572-5a5a-be7d-2c74928956c5', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b28831f-48, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b28831f-48, col_values=(('qos', UUID('4f4a9af7-f33e-4531-8ccd-fa64898253de')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b28831f-48, col_values=(('external_ids', {'iface-id': '8b28831f-48a0-4a0f-9697-857d854a22cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:47:fe', 'vm-uuid': 'cad6ec15-92ec-44f9-bb56-17620a43e847'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: INFO os_vif [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48')
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No VIF found with MAC fa:16:3e:b1:47:fe, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] No waiting events found dispatching network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:08 user nova-compute[74048]: WARNING nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received unexpected event network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 for instance with vm_state building and task_state spawning.
Oct 25 16:39:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] No waiting events found dispatching network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:08 user nova-compute[74048]: WARNING nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received unexpected event network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc for instance with vm_state building and task_state spawning.
Oct 25 16:39:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] No waiting events found dispatching network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:08 user nova-compute[74048]: WARNING nova.compute.manager [req-e98802d0-6212-40b8-ab50-191ccfc35796 req-215e0c1f-ee80-4fea-bbc8-549df3a1c878 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received unexpected event network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc for instance with vm_state building and task_state spawning.
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:39:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Instance spawned successfully.
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: INFO nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Took 6.62 seconds to spawn the instance on the hypervisor.
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:39:09 user nova-compute[74048]: INFO nova.compute.manager [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Took 7.49 seconds to build instance.
Oct 25 16:39:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-977a11d2-a759-4b7b-afbf-7e9688ef3ae1 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.601s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:39:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Instance spawned successfully.
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:10 user nova-compute[74048]: INFO nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 25 16:39:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:39:10 user nova-compute[74048]: INFO nova.compute.manager [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Took 30.94 seconds to build instance.
Oct 25 16:39:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-164ff75f-87de-4afa-9528-cfd528f8b911 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.078s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:11 user nova-compute[74048]: INFO nova.compute.manager [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Unrescuing
Oct 25 16:39:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'flavor' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-2c804ad2-fac8-4393-9dcf-9c004d0bf1b9 req-57fb0df6-3a51-4f31-9c5e-30523e04e967 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c804ad2-fac8-4393-9dcf-9c004d0bf1b9 req-57fb0df6-3a51-4f31-9c5e-30523e04e967 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c804ad2-fac8-4393-9dcf-9c004d0bf1b9 req-57fb0df6-3a51-4f31-9c5e-30523e04e967 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c804ad2-fac8-4393-9dcf-9c004d0bf1b9 req-57fb0df6-3a51-4f31-9c5e-30523e04e967 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-2c804ad2-fac8-4393-9dcf-9c004d0bf1b9 req-57fb0df6-3a51-4f31-9c5e-30523e04e967 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:12 user nova-compute[74048]: WARNING nova.compute.manager [req-2c804ad2-fac8-4393-9dcf-9c004d0bf1b9 req-57fb0df6-3a51-4f31-9c5e-30523e04e967 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance destroyed successfully.
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:14 user nova-compute[74048]: WARNING nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:14 user nova-compute[74048]: WARNING nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:14 user nova-compute[74048]: WARNING nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:14 user nova-compute[74048]: WARNING nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:14 user nova-compute[74048]: WARNING nova.compute.manager [req-913d15c4-dbee-4a08-9c8e-64c3ab4f2fcc req-c15e5d88-e2f7-46e8-918a-4f9823e2cac7 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:16 user nova-compute[74048]: WARNING nova.compute.manager [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:16 user nova-compute[74048]: WARNING nova.compute.manager [req-73f0df34-4cdb-4a0a-bf3c-cbd7917e49a9 req-0f9145c8-3e8f-46c2-900a-afbb47c50de2 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a15e356f-d21b-4fd5-94b0-95438f576919 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing instance network info cache due to event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:19 user nova-compute[74048]: INFO nova.compute.manager [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Detaching volume a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:39:20 user nova-compute[74048]: INFO nova.virt.block_device [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Attempting to driver detach volume a116c331-690a-4ad3-9f20-896a1256cab0 from mountpoint /dev/vdb
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Attempting to detach device vdb from instance c7c52922-5f40-4d8b-937d-9cec99edd27f from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:39:20 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:39:20 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:39:20 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:39:20 user nova-compute[74048]:   <serial>a116c331-690a-4ad3-9f20-896a1256cab0</serial>
Oct 25 16:39:20 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:39:20 user nova-compute[74048]: </disk>
Oct 25 16:39:20 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:39:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully detached device vdb from instance c7c52922-5f40-4d8b-937d-9cec99edd27f from the persistent domain config.
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7c52922-5f40-4d8b-937d-9cec99edd27f from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:39:20 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:39:20 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:39:20 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:39:20 user nova-compute[74048]:   <serial>a116c331-690a-4ad3-9f20-896a1256cab0</serial>
Oct 25 16:39:20 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:39:20 user nova-compute[74048]: </disk>
Oct 25 16:39:20 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updated VIF entry in instance network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.network.neutron [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ccd99e75-20a3-4401-a88a-47fe93103f16 req-bf129543-3eb3-4e10-b6c8-5db9ac93062a service nova] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:39:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing instance network info cache due to event network-changed-eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] Acquiring lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] Acquired lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG nova.network.neutron [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Refreshing network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG nova.network.neutron [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updated VIF entry in instance network info cache for port eca5c7af-25bc-4905-8a8d-927cf755084f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG nova.network.neutron [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [{"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-47d123dc-3948-4eb4-a94a-fe91acacbe2a req-c1e9d1c6-781d-4a4d-aec8-64b06abeea82 service nova] Releasing lock "refresh_cache-c7c52922-5f40-4d8b-937d-9cec99edd27f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:32 user nova-compute[74048]: INFO nova.compute.manager [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Unrescuing
Oct 25 16:39:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'flavor' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-5694e57a-fbc6-415f-b061-c74388cc5eb4 req-eac7e15c-4e1e-445e-9abd-70357d78b18b service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5694e57a-fbc6-415f-b061-c74388cc5eb4 req-eac7e15c-4e1e-445e-9abd-70357d78b18b service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5694e57a-fbc6-415f-b061-c74388cc5eb4 req-eac7e15c-4e1e-445e-9abd-70357d78b18b service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5694e57a-fbc6-415f-b061-c74388cc5eb4 req-eac7e15c-4e1e-445e-9abd-70357d78b18b service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-5694e57a-fbc6-415f-b061-c74388cc5eb4 req-eac7e15c-4e1e-445e-9abd-70357d78b18b service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:33 user nova-compute[74048]: WARNING nova.compute.manager [req-5694e57a-fbc6-415f-b061-c74388cc5eb4 req-eac7e15c-4e1e-445e-9abd-70357d78b18b service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:34 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance destroyed successfully.
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing instance network info cache due to event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updated VIF entry in instance network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.network.neutron [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-01a179a7-7386-4a00-a32b-b7b5f27898e8 req-a8222c19-64c7-4312-bb8b-d1322058eca1 service nova] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:34 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:39:34 user nova-compute[74048]: INFO nova.compute.claims [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Claim successful on node user
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:39:35 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.policy [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8fb16c6fa0c4e3a8e8b05bd0222b4ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc9602800254bc4bf71768c629c59cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:39:35 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Creating image(s)
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-22b8c08c-244e-4553-b767-a4c38c1fefce req-6131786a-c400-401f-ab3e-4583097d68c6 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-22b8c08c-244e-4553-b767-a4c38c1fefce req-6131786a-c400-401f-ab3e-4583097d68c6 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-22b8c08c-244e-4553-b767-a4c38c1fefce req-6131786a-c400-401f-ab3e-4583097d68c6 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-22b8c08c-244e-4553-b767-a4c38c1fefce req-6131786a-c400-401f-ab3e-4583097d68c6 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-22b8c08c-244e-4553-b767-a4c38c1fefce req-6131786a-c400-401f-ab3e-4583097d68c6 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:35 user nova-compute[74048]: WARNING nova.compute.manager [req-22b8c08c-244e-4553-b767-a4c38c1fefce req-6131786a-c400-401f-ab3e-4583097d68c6 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.250s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk 1073741824" returned: 0 in 0.060s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing instance network info cache due to event network-changed-a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Refreshing network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Successfully created port: 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Cannot resize image /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Ensure instance console log exists: /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updated VIF entry in instance network info cache for port a87afd20-35e1-40f8-81e2-ad3964a04feb. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-675c7f57-733f-4437-bcfa-8e626b90db0e req-6584457f-a4ef-4186-bbe5-24571115fd4c service nova] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Successfully updated port: 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance network_info: |[{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Start _get_guest_xml network_info=[{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:39:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:37 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804756607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804756607',id=29,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNbVnkdtNdNw8mJMazZxYiak8LlGr87f9Wl9L056mc/2DvMhhEQ79Hfh5KiTQ0ly8vgBLYp5ed6qLOGZgmPoB36An89liZ7jiiyCDPLLvgC5Of19DBrwWuaEINZGZRJGg==',key_name='tempest-keypair-179865634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-j67ek4e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=32eb3254-db05-4a3f-a880-80f3757f0676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'pci_devices' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:39:37 user nova-compute[74048]:   <uuid>32eb3254-db05-4a3f-a880-80f3757f0676</uuid>
Oct 25 16:39:37 user nova-compute[74048]:   <name>instance-0000001d</name>
Oct 25 16:39:37 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:39:37 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:39:37 user nova-compute[74048]:   <metadata>
Oct 25 16:39:37 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:39:37 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:39:37 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1804756607</nova:name>
Oct 25 16:39:37 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:39:37</nova:creationTime>
Oct 25 16:39:37 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:39:37 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:39:37 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:39:37 user nova-compute[74048]:       <nova:owner>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:user uuid="b8fb16c6fa0c4e3a8e8b05bd0222b4ba">tempest-AttachVolumeShelveTestJSON-1185084699-project-member</nova:user>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:project uuid="5dc9602800254bc4bf71768c629c59cf">tempest-AttachVolumeShelveTestJSON-1185084699</nova:project>
Oct 25 16:39:37 user nova-compute[74048]:       </nova:owner>
Oct 25 16:39:37 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:39:37 user nova-compute[74048]:       <nova:ports>
Oct 25 16:39:37 user nova-compute[74048]:         <nova:port uuid="5b442979-bc1e-4ac2-93d5-530ecbb05ab9">
Oct 25 16:39:37 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:39:37 user nova-compute[74048]:         </nova:port>
Oct 25 16:39:37 user nova-compute[74048]:       </nova:ports>
Oct 25 16:39:37 user nova-compute[74048]:     </nova:instance>
Oct 25 16:39:37 user nova-compute[74048]:   </metadata>
Oct 25 16:39:37 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:39:37 user nova-compute[74048]:     <system>
Oct 25 16:39:37 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:39:37 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:39:37 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:39:37 user nova-compute[74048]:       <entry name="serial">32eb3254-db05-4a3f-a880-80f3757f0676</entry>
Oct 25 16:39:37 user nova-compute[74048]:       <entry name="uuid">32eb3254-db05-4a3f-a880-80f3757f0676</entry>
Oct 25 16:39:37 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:39:37 user nova-compute[74048]:     </system>
Oct 25 16:39:37 user nova-compute[74048]:   </sysinfo>
Oct 25 16:39:37 user nova-compute[74048]:   <os>
Oct 25 16:39:37 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:39:37 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:39:37 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:39:37 user nova-compute[74048]:   </os>
Oct 25 16:39:37 user nova-compute[74048]:   <features>
Oct 25 16:39:37 user nova-compute[74048]:     <acpi/>
Oct 25 16:39:37 user nova-compute[74048]:     <apic/>
Oct 25 16:39:37 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:39:37 user nova-compute[74048]:   </features>
Oct 25 16:39:37 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:39:37 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:39:37 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:39:37 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:39:37 user nova-compute[74048]:   </clock>
Oct 25 16:39:37 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:39:37 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:39:37 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:39:37 user nova-compute[74048]:   </cpu>
Oct 25 16:39:37 user nova-compute[74048]:   <devices>
Oct 25 16:39:37 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:39:37 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:39:37 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk"/>
Oct 25 16:39:37 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:39:37 user nova-compute[74048]:     </disk>
Oct 25 16:39:37 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:39:37 user nova-compute[74048]:       <mac address="fa:16:3e:f1:a6:63"/>
Oct 25 16:39:37 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:39:37 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:39:37 user nova-compute[74048]:       <target dev="tap5b442979-bc"/>
Oct 25 16:39:37 user nova-compute[74048]:     </interface>
Oct 25 16:39:37 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:39:37 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/console.log" append="off"/>
Oct 25 16:39:37 user nova-compute[74048]:     </serial>
Oct 25 16:39:37 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:39:37 user nova-compute[74048]:     <video>
Oct 25 16:39:37 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:39:37 user nova-compute[74048]:     </video>
Oct 25 16:39:37 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:39:37 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:39:37 user nova-compute[74048]:     </rng>
Oct 25 16:39:37 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:39:37 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:39:37 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:39:37 user nova-compute[74048]:     </memballoon>
Oct 25 16:39:37 user nova-compute[74048]:   </devices>
Oct 25 16:39:37 user nova-compute[74048]: </domain>
Oct 25 16:39:37 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804756607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804756607',id=29,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNbVnkdtNdNw8mJMazZxYiak8LlGr87f9Wl9L056mc/2DvMhhEQ79Hfh5KiTQ0ly8vgBLYp5ed6qLOGZgmPoB36An89liZ7jiiyCDPLLvgC5Of19DBrwWuaEINZGZRJGg==',key_name='tempest-keypair-179865634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-j67ek4e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=32eb3254-db05-4a3f-a880-80f3757f0676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG os_vif [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28bfcfbf-5b23-5510-a83b-188494981bf0', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b442979-bc, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b442979-bc, col_values=(('qos', UUID('33b1505a-0ee9-4e81-8289-5ce2b07e4732')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b442979-bc, col_values=(('external_ids', {'iface-id': '5b442979-bc1e-4ac2-93d5-530ecbb05ab9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:a6:63', 'vm-uuid': '32eb3254-db05-4a3f-a880-80f3757f0676'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:37 user nova-compute[74048]: INFO os_vif [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc')
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No VIF found with MAC fa:16:3e:f1:a6:63, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:37 user nova-compute[74048]: WARNING nova.compute.manager [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:37 user nova-compute[74048]: WARNING nova.compute.manager [req-e85b2d42-7c7c-47ec-a697-7472b1258bb7 req-c538fc76-55d2-43c0-b494-1c113d8410d7 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:39:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-484a2c0a-0680-4627-b6ca-15b294a030e3 tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing instance network info cache due to event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updated VIF entry in instance network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-336e6c77-fb6c-44b0-9c61-e4d52ae0a799 req-104dc4bd-aab2-44db-8c47-20014846f9e6 service nova] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-493615ef-48bc-4e03-a8e0-4bb096f8e6f9 req-86de5d9f-1162-4eb1-8f92-5e3cfc67a988 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-493615ef-48bc-4e03-a8e0-4bb096f8e6f9 req-86de5d9f-1162-4eb1-8f92-5e3cfc67a988 service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-493615ef-48bc-4e03-a8e0-4bb096f8e6f9 req-86de5d9f-1162-4eb1-8f92-5e3cfc67a988 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-493615ef-48bc-4e03-a8e0-4bb096f8e6f9 req-86de5d9f-1162-4eb1-8f92-5e3cfc67a988 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-493615ef-48bc-4e03-a8e0-4bb096f8e6f9 req-86de5d9f-1162-4eb1-8f92-5e3cfc67a988 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:39 user nova-compute[74048]: WARNING nova.compute.manager [req-493615ef-48bc-4e03-a8e0-4bb096f8e6f9 req-86de5d9f-1162-4eb1-8f92-5e3cfc67a988 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state building and task_state spawning.
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:40 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c7c52922-5f40-4d8b-937d-9cec99edd27f is timed out.
Oct 25 16:39:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully detached device vdb from instance c7c52922-5f40-4d8b-937d-9cec99edd27f from the live domain config.
Oct 25 16:39:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNzMlRdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:39:40 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab2ca6-48be-4d4f-aa2f-30dee0d27828]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:39:40 user nova-compute[74048]: No targets found.
Oct 25 16:39:40 user nova-compute[74048]: iSNS:
Oct 25 16:39:40 user nova-compute[74048]: No targets found.
Oct 25 16:39:40 user nova-compute[74048]: STATIC:
Oct 25 16:39:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:39:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:39:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:39:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90
Oct 25 16:39:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:39:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:39:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:39:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:39:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:39:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0
Oct 25 16:39:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:39:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:39:40 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:39:40 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:39:40 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:39:40 user nova-compute[74048]: FIRMWARE:
Oct 25 16:39:40 user nova-compute[74048]: No targets found.
Oct 25 16:39:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:39:40 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:39:40 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f354f7b-cd4c-4c93-ab45-0f2d3aa85ef3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045bbfb-f811-4fd4-b3bb-1a447dda55d1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:39:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18581588b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5bed58-d558-47a4-bba0-d4168e7fd394]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1780ce-10ea-4c7e-9c48-ebdd9017dead]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[579c281a-e7fe-456c-b60c-db309fc0f8fe]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb744db-97b1-4d44-ad1d-f39783d3893a]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb878d4-e51d-489a-967c-0f074e5eb2c5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[688a879e-551b-4d47-9c77-b17636537014]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260]
Oct 25 16:39:40 user nova-compute[74048]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0, portal: 172.16.0.220,3260] successful.
Oct 25 16:39:40 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a116c331-690a-4ad3-9f20-896a1256cab0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d3b901-7a58-4618-beb6-57bf6d95e24f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] <== disconnect_volume: return (390ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:39:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance spawned successfully.
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-03564a64-788f-4ea8-ad99-c065e71ff215 req-7700ec83-73c9-469c-ae30-2a815de70d48 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-03564a64-788f-4ea8-ad99-c065e71ff215 req-7700ec83-73c9-469c-ae30-2a815de70d48 service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-03564a64-788f-4ea8-ad99-c065e71ff215 req-7700ec83-73c9-469c-ae30-2a815de70d48 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-03564a64-788f-4ea8-ad99-c065e71ff215 req-7700ec83-73c9-469c-ae30-2a815de70d48 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.compute.manager [req-03564a64-788f-4ea8-ad99-c065e71ff215 req-7700ec83-73c9-469c-ae30-2a815de70d48 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:39:41 user nova-compute[74048]: WARNING nova.compute.manager [req-03564a64-788f-4ea8-ad99-c065e71ff215 req-7700ec83-73c9-469c-ae30-2a815de70d48 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state building and task_state spawning.
Oct 25 16:39:41 user nova-compute[74048]: INFO nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 25 16:39:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:39:41 user nova-compute[74048]: INFO nova.compute.manager [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Took 6.88 seconds to build instance.
Oct 25 16:39:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b53df5a3-2126-4cba-840a-864b17cb7068 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.985s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:42 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'flavor' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d18e1d1d-8dde-4455-8767-d44564487d1e tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.139s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:39:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG nova.objects.instance [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'flavor' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:44 user nova-compute[74048]: INFO nova.compute.manager [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Attaching volume 9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 to /dev/vdb
Oct 25 16:39:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG os_brick.utils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2617909-0976-431d-9e33-f05de980e672]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad5a4b-4559-4c89-86cf-b3285d21fba3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b459e96-f1dd-4a2d-a2dc-0e3fe67ec81d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6704e-64b1-4a7c-96d6-51f481307f63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:39:45 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ccb5c-af6b-46bf-b4a8-a6937148e290]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG os_brick.utils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating existing volume attachment record: bb99e843-c7b0-4add-90d9-f9e35cfa4277 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updating instance_info_cache with network_info: [{"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:45 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:39:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:39:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:39:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7467MB free_disk=25.046775817871094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance c7c52922-5f40-4d8b-937d-9cec99edd27f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance cad6ec15-92ec-44f9-bb56-17620a43e847 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 761fc401-6c6a-4d05-91e5-875c54b27e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 32eb3254-db05-4a3f-a880-80f3757f0676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:39:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:39:54 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:39:54 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:39:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:39:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:39:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing instance network info cache due to event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updated VIF entry in instance network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fb4b06d4-38f7-4331-a704-e3ecf87b84c9 req-40179c79-2d7a-401a-9718-523dd45cbb40 service nova] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing instance network info cache due to event network-changed-963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] Acquiring lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] Acquired lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.network.neutron [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Refreshing network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:39:58 user nova-compute[74048]: INFO nova.compute.manager [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Detaching volume 7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:39:58 user nova-compute[74048]: INFO nova.virt.block_device [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Attempting to driver detach volume 7871e2f8-746b-4bed-b5f6-c35104c08084 from mountpoint /dev/vdb
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Attempting to detach device vdb from instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:39:58 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:39:58 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:39:58 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:39:58 user nova-compute[74048]:   <serial>7871e2f8-746b-4bed-b5f6-c35104c08084</serial>
Oct 25 16:39:58 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 16:39:58 user nova-compute[74048]: </disk>
Oct 25 16:39:58 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:39:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully detached device vdb from instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 from the persistent domain config.
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:39:58 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:39:58 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:39:58 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:39:58 user nova-compute[74048]:   <serial>7871e2f8-746b-4bed-b5f6-c35104c08084</serial>
Oct 25 16:39:58 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 16:39:58 user nova-compute[74048]: </disk>
Oct 25 16:39:58 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.network.neutron [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updated VIF entry in instance network info cache for port 963fe763-7fca-4fe8-bf4d-a252959c94fd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG nova.network.neutron [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [{"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:39:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60afa94f-9343-4a9f-8810-021dca71f012 req-adce433c-6f78-441c-be34-bce7fdb4ed7f service nova] Releasing lock "refresh_cache-af48ff38-5eaa-4885-839d-bd8b8d6d4de4" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:39:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:40:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:04 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:04 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:04 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c456131e-3798-4daf-9683-b90a8e7387c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:40:04 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60d72df-050d-471c-a2f1-4c0363c024d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1] added
Oct 25 16:40:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a4240-b1dd-4c61-9898-b8e95c62d6a6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541c908-47db-4804-81b0-16a0fee69a27]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkdJBwOe {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkdJBwOe" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[691fde0b-3412-4b99-b6cb-cfebb73de5fa]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkdJBwOe'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c942b6d1-3e13-425b-be4b-fed0742973e0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a26b7c-8afb-4f3f-9b90-75ce5d307180]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea77963-c5d5-4a28-9e33-3933ff9c1f65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]
Oct 25 16:40:04 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.
Oct 25 16:40:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[992232ef-d447-4cc5-9fb5-76818bcfccde]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef25f6-ccfe-4bef-b0c3-354c1e752151]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:40:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:40:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ff8c36-143c-4296-95da-0d66781e9fcd]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:05 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:40:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:40:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26437333631313531', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333631313531', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.objects.instance [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'flavor' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:40:06 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:40:06 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:40:06 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:40:06 user nova-compute[74048]:   <serial>9a7ae9af-5c37-49be-8385-4ac04dc8c8e1</serial>
Oct 25 16:40:06 user nova-compute[74048]: </disk>
Oct 25 16:40:06 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:06 user nova-compute[74048]: INFO nova.compute.manager [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Detaching volume 8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:40:06 user nova-compute[74048]: INFO nova.virt.block_device [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Attempting to driver detach volume 8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 from mountpoint /dev/vdb
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Attempting to detach device vdb from instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:40:06 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:40:06 user nova-compute[74048]:   <source dev="/dev/sdh"/>
Oct 25 16:40:06 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:40:06 user nova-compute[74048]:   <serial>8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0</serial>
Oct 25 16:40:06 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:40:06 user nova-compute[74048]: </disk>
Oct 25 16:40:06 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:40:06 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Successfully detached device vdb from instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 from the persistent domain config.
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:40:06 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:40:06 user nova-compute[74048]:   <source dev="/dev/sdh"/>
Oct 25 16:40:06 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:40:06 user nova-compute[74048]:   <serial>8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0</serial>
Oct 25 16:40:06 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:40:06 user nova-compute[74048]: </disk>
Oct 25 16:40:06 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No VIF found with MAC fa:16:3e:c1:c0:a3, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-13f8f5fc-e562-4753-9095-de99ad33ade6 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.709s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:40:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Stashing vm_state: active {{(pid=74048) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 16:40:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:08 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:40:08 user nova-compute[74048]: INFO nova.compute.claims [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Claim successful on node user
Oct 25 16:40:08 user nova-compute[74048]: INFO nova.compute.resource_tracker [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating resource usage from migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39
Oct 25 16:40:09 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.460s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:09 user nova-compute[74048]: INFO nova.compute.manager [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Migrating
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:40:09 user nova-compute[74048]: INFO nova.compute.rpcapi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:40:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Starting migrate_disk_and_power_off {{(pid=74048) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-f1559c56-be80-4e82-9b6b-3e0350a1361e req-6305aa13-0567-4f14-ae33-6b5f771d7196 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f1559c56-be80-4e82-9b6b-3e0350a1361e req-6305aa13-0567-4f14-ae33-6b5f771d7196 service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f1559c56-be80-4e82-9b6b-3e0350a1361e req-6305aa13-0567-4f14-ae33-6b5f771d7196 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f1559c56-be80-4e82-9b6b-3e0350a1361e req-6305aa13-0567-4f14-ae33-6b5f771d7196 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-f1559c56-be80-4e82-9b6b-3e0350a1361e req-6305aa13-0567-4f14-ae33-6b5f771d7196 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:10 user nova-compute[74048]: WARNING nova.compute.manager [req-f1559c56-be80-4e82-9b6b-3e0350a1361e req-6305aa13-0567-4f14-ae33-6b5f771d7196 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state active and task_state resize_migrating.
Oct 25 16:40:10 user nova-compute[74048]: INFO nova.compute.manager [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Terminating instance
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance destroyed successfully.
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:40:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb225761b-69, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bdb51bc-a44e-499c-be0f-b57b53397fbd) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:10 user nova-compute[74048]: INFO os_vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69')
Oct 25 16:40:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:10 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc76cdd-845b-4762-9c77-ade9bf1fe551]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:40:10 user nova-compute[74048]: No targets found.
Oct 25 16:40:10 user nova-compute[74048]: iSNS:
Oct 25 16:40:10 user nova-compute[74048]: No targets found.
Oct 25 16:40:10 user nova-compute[74048]: STATIC:
Oct 25 16:40:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:40:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90
Oct 25 16:40:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1
Oct 25 16:40:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:40:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:10 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:40:10 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:10 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:10 user nova-compute[74048]: FIRMWARE:
Oct 25 16:40:10 user nova-compute[74048]: No targets found.
Oct 25 16:40:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:40:10 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:40:10 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[33063ec7-ea36-4e34-9121-79eda73e7418]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[595fb172-01ef-4e66-a730-dc1de68f8a34]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:40:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840311e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da5068-7526-49c7-8b46-78fcbc0679dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8829b9-9ac3-48a6-a3b7-114981c45d22]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f3fba-40cf-4248-bfb3-62704035b5ca]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:40:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d601bbac-056c-4eb4-907a-1dd6ed868211]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a99a53-21e5-4853-91e6-9f988e2599cf]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df287512-b7d0-4f99-b2e1-f69ed4214d5c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]
Oct 25 16:40:11 user nova-compute[74048]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.
Oct 25 16:40:11 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae78556-e2a2-4a76-a89c-78cf77844b89]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== disconnect_volume: return (310ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Instance destroyed successfully.
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'resources' on Instance uuid c7c52922-5f40-4d8b-937d-9cec99edd27f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-673488562',display_name='tempest-ServerRescueNegativeTestJSON-server-673488562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-673488562',id=21,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJmNeLNw9htCIEO231GPElA6ydc2Uc3wg0whqBcPQYXqnSe3ubg6fZPtmXkqaWAcNN+Xs134+oixSppb8lj9PqbxooDRz2hA85UXAM6fxBcGkqboSE8AbcT3vJE2dYMXA==',key_name='tempest-keypair-1695340235',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:35:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-qtkf4aw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=c7c52922-5f40-4d8b-937d-9cec99edd27f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "eca5c7af-25bc-4905-8a8d-927cf755084f", "address": "fa:16:3e:32:60:1b", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca5c7af-25", "ovs_interfaceid": "eca5c7af-25bc-4905-8a8d-927cf755084f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG os_vif [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeca5c7af-25, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e62fef19-05bb-46ab-8b10-378ac217ca3b) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:11 user nova-compute[74048]: INFO os_vif [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:60:1b,bridge_name='br-int',has_traffic_filtering=True,id=eca5c7af-25bc-4905-8a8d-927cf755084f,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca5c7af-25')
Oct 25 16:40:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Deleting instance files /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f_del
Oct 25 16:40:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Deletion of /opt/stack/data/nova/instances/c7c52922-5f40-4d8b-937d-9cec99edd27f_del complete
Oct 25 16:40:11 user nova-compute[74048]: INFO nova.compute.manager [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44_resize/disk /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "cp -r /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44_resize/disk /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk" returned: 0 in 0.400s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44_resize/disk.info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk.info {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "cp -r /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44_resize/disk.info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk.info" returned: 0 in 0.044s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:11 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:12 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Took 0.70 seconds to deallocate network for instance.
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:12 user nova-compute[74048]: WARNING nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state active and task_state resize_migrating.
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:12 user nova-compute[74048]: WARNING nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-unplugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state deleted and task_state None.
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Acquiring lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] No waiting events found dispatching network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:12 user nova-compute[74048]: WARNING nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received unexpected event network-vif-plugged-eca5c7af-25bc-4905-8a8d-927cf755084f for instance with vm_state deleted and task_state None.
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-45b65b82-3996-406b-8159-dce3e0afa100 req-e475aab3-ef55-4661-a8b8-09fcc4612ee4 service nova] [instance: c7c52922-5f40-4d8b-937d-9cec99edd27f] Received event network-vif-deleted-eca5c7af-25bc-4905-8a8d-927cf755084f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:12 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Deleted allocations for instance c7c52922-5f40-4d8b-937d-9cec99edd27f
Oct 25 16:40:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-06c117b7-671c-4059-b04c-27d01bee6017 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "c7c52922-5f40-4d8b-937d-9cec99edd27f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Port b225761b-69af-459c-ad4e-8901ba049969 binding to destination host user is already ACTIVE {{(pid=74048) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG os_brick.utils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c3f68f-31b5-4a25-b24a-3eae7f260794]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c25b55-91b3-4b1a-b969-235cdd04a5ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab30c4-8e6a-45d6-8f7a-dedc9b342adc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce37526-1e59-40c3-8357-516e26ec4942]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:40:13 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:40:13 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[125e6dd0-be5a-4c84-b5fa-f19721f65667]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:40:13 user nova-compute[74048]: DEBUG os_brick.utils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:19 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 is timed out.
Oct 25 16:40:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully detached device vdb from instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 from the live domain config.
Oct 25 16:40:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'igkAQqRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:19 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e57fcdb-219e-41d6-b190-0278ef0ab844]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:40:19 user nova-compute[74048]: No targets found.
Oct 25 16:40:19 user nova-compute[74048]: iSNS:
Oct 25 16:40:19 user nova-compute[74048]: No targets found.
Oct 25 16:40:19 user nova-compute[74048]: STATIC:
Oct 25 16:40:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:40:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90
Oct 25 16:40:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:40:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:19 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084
Oct 25 16:40:19 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:19 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:19 user nova-compute[74048]: FIRMWARE:
Oct 25 16:40:19 user nova-compute[74048]: No targets found.
Oct 25 16:40:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:40:19 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:40:19 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a9ddc-1a2b-410f-86fc-c97a4fa808cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8076e12c-868e-42be-aceb-1028bfb0c69a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184066e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19151b26-1b7f-41fc-a242-70676900263c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f16e28-4f9a-4257-a454-55ee172963fd]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaddb0b-f95c-4855-b720-23b7a319757b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f667c-9db4-44c6-90a4-6726024a8630]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fdeea9-f890-4f6c-ad3e-aaa8d7098d0f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd48025f-d09e-4245-b658-493dbb1755ff]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260]
Oct 25 16:40:19 user nova-compute[74048]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084, portal: 172.16.0.220,3260] successful.
Oct 25 16:40:19 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7871e2f8-746b-4bed-b5f6-c35104c08084 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c15621-d135-46e2-ab63-afcafa6bc950]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== disconnect_volume: return (303ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:40:20 user nova-compute[74048]: DEBUG nova.objects.instance [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'flavor' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8ceaadcb-2bb7-47f3-a24e-5f81a6486a36 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.916s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:26 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 is timed out.
Oct 25 16:40:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Successfully detached device vdb from instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 from the live domain config.
Oct 25 16:40:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOLRqeJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:26 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b430b1-e6b0-489f-8a9d-c4a73734ef22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:40:26 user nova-compute[74048]: No targets found.
Oct 25 16:40:26 user nova-compute[74048]: iSNS:
Oct 25 16:40:26 user nova-compute[74048]: No targets found.
Oct 25 16:40:26 user nova-compute[74048]: STATIC:
Oct 25 16:40:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0
Oct 25 16:40:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90
Oct 25 16:40:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:40:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:26 user nova-compute[74048]: FIRMWARE:
Oct 25 16:40:26 user nova-compute[74048]: No targets found.
Oct 25 16:40:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:40:26 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:40:26 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[589a9a15-dd3b-4b21-827a-2bb8e11ac7f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6470891-e887-4316-836b-8743a2fb0c02]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:26 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:26 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:26 user nova-compute[74048]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 (non-flash)
Oct 25 16:40:26 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184043b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0'): ({'sdh'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Removing single pathed devices sdh {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f367d-e05c-49f8-9e49-5d19c253f6bc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd5bf33-b678-4a79-8558-c88ab902ff13]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Flushing IO for device /dev/sdh {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:40:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[869173cd-a10a-43ec-a177-afcd534aff47]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea71958-98b0-4da4-a69f-ff9f0210e1e6]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] SCSI volumes sdh have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a9c30-0606-412b-9625-289d2270f6b2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8938129-29bf-43fc-bfa0-edcd01cef5ca]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260]
Oct 25 16:40:27 user nova-compute[74048]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0, portal: 172.16.0.220,3260] successful.
Oct 25 16:40:27 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a6a9de6-fd57-4b21-bd2c-9ee20d062ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[76216cab-c1d7-4676-bb51-5d84e2173bcb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] <== disconnect_volume: return (285ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:29 user nova-compute[74048]: INFO nova.compute.manager [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Terminating instance
Oct 25 16:40:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-5175cd26-13b5-43c0-97c0-c19263c002da req-7c6c68d7-7e8d-4cdd-be81-6522ace4a2f0 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-vif-unplugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5175cd26-13b5-43c0-97c0-c19263c002da req-7c6c68d7-7e8d-4cdd-be81-6522ace4a2f0 service nova] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5175cd26-13b5-43c0-97c0-c19263c002da req-7c6c68d7-7e8d-4cdd-be81-6522ace4a2f0 service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5175cd26-13b5-43c0-97c0-c19263c002da req-7c6c68d7-7e8d-4cdd-be81-6522ace4a2f0 service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-5175cd26-13b5-43c0-97c0-c19263c002da req-7c6c68d7-7e8d-4cdd-be81-6522ace4a2f0 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] No waiting events found dispatching network-vif-unplugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.compute.manager [req-5175cd26-13b5-43c0-97c0-c19263c002da req-7c6c68d7-7e8d-4cdd-be81-6522ace4a2f0 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-vif-unplugged-8b28831f-48a0-4a0f-9697-857d854a22cc for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:40:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Instance destroyed successfully.
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.objects.instance [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'resources' on Instance uuid cad6ec15-92ec-44f9-bb56-17620a43e847 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:38:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1712295321',display_name='tempest-TestVolumeBootPattern-server-1712295321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1712295321',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:39:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-10y5kelx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:39:10Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=cad6ec15-92ec-44f9-bb56-17620a43e847,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "8b28831f-48a0-4a0f-9697-857d854a22cc", "address": "fa:16:3e:b1:47:fe", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b28831f-48", "ovs_interfaceid": "8b28831f-48a0-4a0f-9697-857d854a22cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_vif [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b28831f-48, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f4a9af7-f33e-4531-8ccd-fa64898253de) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:30 user nova-compute[74048]: INFO os_vif [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:47:fe,bridge_name='br-int',has_traffic_filtering=True,id=8b28831f-48a0-4a0f-9697-857d854a22cc,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b28831f-48')
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gNtKyLIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:30 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399adb7-e761-4ea2-890a-5fff9718a29a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:40:30 user nova-compute[74048]: No targets found.
Oct 25 16:40:30 user nova-compute[74048]: iSNS:
Oct 25 16:40:30 user nova-compute[74048]: No targets found.
Oct 25 16:40:30 user nova-compute[74048]: STATIC:
Oct 25 16:40:30 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90
Oct 25 16:40:30 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:30 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:30 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:40:30 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:40:30 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:40:30 user nova-compute[74048]: FIRMWARE:
Oct 25 16:40:30 user nova-compute[74048]: No targets found.
Oct 25 16:40:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:40:30 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:40:30 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6c335-a849-4f1f-8f3f-bcf623ee6221]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e33c5c2-c4a9-4385-8f0a-1a127c1bc4a6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:30 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:30 user nova-compute[74048]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 (non-flash)
Oct 25 16:40:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18584a8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90'): ({'sde'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Removing single pathed devices sde {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c113da91-fdba-47d6-a3d3-5617964260b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0699f-5606-4dd4-8acd-e3b5774ec6cc]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flushing IO for device /dev/sde {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8bf4e4-6aca-4098-b429-e12e5c374281]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc023a45-df73-4a0c-9ffe-1a7975364d02]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23033356433363636', '/dev/disk/by-id/scsi-1SCST_BIO59e08a6e-035d36666bc50e08', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_59e08a6e') {{(pid=85401) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 16:40:30 user nova-compute[74048]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23033356433363636
Oct 25 16:40:30 user nova-compute[74048]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO59e08a6e-035d36666bc50e08
Oct 25 16:40:30 user nova-compute[74048]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_59e08a6e
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7360eaa6-011f-488e-8e54-bb6aa3803d84]: (4, None) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a2befa-5724-4c39-bf6a-bf3a2c1ab20e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda3514a-cb27-4036-bfa0-6037cbf6e420]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260]
Oct 25 16:40:30 user nova-compute[74048]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90, portal: 172.16.0.220,3260] successful.
Oct 25 16:40:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3d23225-f576-4bfd-92af-749b9ba40c90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6e78d4-645c-4092-aa01-396a93d91810]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== disconnect_volume: return (310ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:40:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Deleting instance files /opt/stack/data/nova/instances/cad6ec15-92ec-44f9-bb56-17620a43e847_del
Oct 25 16:40:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Deletion of /opt/stack/data/nova/instances/cad6ec15-92ec-44f9-bb56-17620a43e847_del complete
Oct 25 16:40:31 user nova-compute[74048]: INFO nova.compute.manager [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 25 16:40:31 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:40:31 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:40:31 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:40:31 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:31 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Took 0.40 seconds to deallocate network for instance.
Oct 25 16:40:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-fbe17c05-c28d-4731-bad6-129404a959c9 req-ef617c3c-3e8d-4049-a44a-a493da404435 service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-vif-deleted-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-4d15beaa-9205-470c-9eb3-d0d20097c867 req-a4cd6ef4-5666-43d1-b3df-de71d3546f2b service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received event network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4d15beaa-9205-470c-9eb3-d0d20097c867 req-a4cd6ef4-5666-43d1-b3df-de71d3546f2b service nova] Acquiring lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4d15beaa-9205-470c-9eb3-d0d20097c867 req-a4cd6ef4-5666-43d1-b3df-de71d3546f2b service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4d15beaa-9205-470c-9eb3-d0d20097c867 req-a4cd6ef4-5666-43d1-b3df-de71d3546f2b service nova] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-4d15beaa-9205-470c-9eb3-d0d20097c867 req-a4cd6ef4-5666-43d1-b3df-de71d3546f2b service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] No waiting events found dispatching network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:32 user nova-compute[74048]: WARNING nova.compute.manager [req-4d15beaa-9205-470c-9eb3-d0d20097c867 req-a4cd6ef4-5666-43d1-b3df-de71d3546f2b service nova] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Received unexpected event network-vif-plugged-8b28831f-48a0-4a0f-9697-857d854a22cc for instance with vm_state active and task_state deleting.
Oct 25 16:40:32 user nova-compute[74048]: INFO nova.compute.manager [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Took 0.86 seconds to detach 1 volumes for instance.
Oct 25 16:40:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: cad6ec15-92ec-44f9-bb56-17620a43e847] Deleting volume: e3d23225-f576-4bfd-92af-749b9ba40c90 {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:32 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Deleted allocations for instance cad6ec15-92ec-44f9-bb56-17620a43e847
Oct 25 16:40:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-af31a4ec-3925-4fc4-84a0-08af3d9fa28e tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "cad6ec15-92ec-44f9-bb56-17620a43e847" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.026s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:38 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:40:38 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:40:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:40 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'flavor' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5980bac5-b84f-443a-91d1-862bd672be3d tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.507s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Starting finish_migration {{(pid=74048) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 16:40:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:40:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Creating image(s)
Oct 25 16:40:40 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk. size=21474836480 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk 21474836480 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk 21474836480" returned: 0 in 0.056s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Ensure instance console log exists: /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start _get_guest_xml network_info=[{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '6443b734-8aeb-4bfe-b846-f0e1ee2d35c5', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7f739b1f-87a3-4521-bf08-c3b395fb0d44', 'attached_at': '2023-10-25T16:40:41.000000', 'detached_at': '', 'volume_id': '9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'serial': '9a7ae9af-5c37-49be-8385-4ac04dc8c8e1'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:40:41 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:40:41 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:40:41 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:41 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:40:41 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa4786-cd20-4ea0-9aea-1d275b9d5d11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:40:41 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad801760-57b9-498a-ba8d-a8838e615587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1] added
Oct 25 16:40:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b55db57-8497-4f58-93e4-c848f1c6ceca]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc710b-52b4-4943-af95-e59f25abcb3f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkdJBwOe {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkdJBwOe" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e990291-1afc-4d55-a7ce-4e6a5a96cf67]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkdJBwOe'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350ea01-767e-42d2-86b0-3060a5ca24c4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e1907f-acd5-4697-9b73-321d78db1504]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201f852-65e8-4a73-8011-b52bc85425e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]
Oct 25 16:40:41 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.
Oct 25 16:40:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad89a4-e94b-4ef5-9bf7-e3ec68bb926f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f816719-48a8-45f0-88e5-bdfdaa15ca16]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:41 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:40:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:40:41 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:40:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27d3a67-15be-43ec-978c-54ed29c0e9f5]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:40:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26437333631313531', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333631313531', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:40:42 user nova-compute[74048]:   <uuid>7f739b1f-87a3-4521-bf08-c3b395fb0d44</uuid>
Oct 25 16:40:42 user nova-compute[74048]:   <name>instance-0000001a</name>
Oct 25 16:40:42 user nova-compute[74048]:   <memory>2097152</memory>
Oct 25 16:40:42 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:40:42 user nova-compute[74048]:   <metadata>
Oct 25 16:40:42 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:40:42 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:40:42 user nova-compute[74048]:       <nova:name>tempest-ServerActionsTestOtherB-server-191961762</nova:name>
Oct 25 16:40:42 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:40:41</nova:creationTime>
Oct 25 16:40:42 user nova-compute[74048]:       <nova:flavor name="m1.small">
Oct 25 16:40:42 user nova-compute[74048]:         <nova:memory>2048</nova:memory>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:disk>20</nova:disk>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:40:42 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:40:42 user nova-compute[74048]:       <nova:owner>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:user uuid="923326e5c82043a59dc710681f5b75d8">tempest-ServerActionsTestOtherB-2012243518-project-member</nova:user>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:project uuid="2991a6a83b4d420fae14308026933e56">tempest-ServerActionsTestOtherB-2012243518</nova:project>
Oct 25 16:40:42 user nova-compute[74048]:       </nova:owner>
Oct 25 16:40:42 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:40:42 user nova-compute[74048]:       <nova:ports>
Oct 25 16:40:42 user nova-compute[74048]:         <nova:port uuid="b225761b-69af-459c-ad4e-8901ba049969">
Oct 25 16:40:42 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:40:42 user nova-compute[74048]:         </nova:port>
Oct 25 16:40:42 user nova-compute[74048]:       </nova:ports>
Oct 25 16:40:42 user nova-compute[74048]:     </nova:instance>
Oct 25 16:40:42 user nova-compute[74048]:   </metadata>
Oct 25 16:40:42 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:40:42 user nova-compute[74048]:     <system>
Oct 25 16:40:42 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:40:42 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:40:42 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:40:42 user nova-compute[74048]:       <entry name="serial">7f739b1f-87a3-4521-bf08-c3b395fb0d44</entry>
Oct 25 16:40:42 user nova-compute[74048]:       <entry name="uuid">7f739b1f-87a3-4521-bf08-c3b395fb0d44</entry>
Oct 25 16:40:42 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:40:42 user nova-compute[74048]:     </system>
Oct 25 16:40:42 user nova-compute[74048]:   </sysinfo>
Oct 25 16:40:42 user nova-compute[74048]:   <os>
Oct 25 16:40:42 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:40:42 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:40:42 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:40:42 user nova-compute[74048]:   </os>
Oct 25 16:40:42 user nova-compute[74048]:   <features>
Oct 25 16:40:42 user nova-compute[74048]:     <acpi/>
Oct 25 16:40:42 user nova-compute[74048]:     <apic/>
Oct 25 16:40:42 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:40:42 user nova-compute[74048]:   </features>
Oct 25 16:40:42 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:40:42 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:40:42 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:40:42 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:40:42 user nova-compute[74048]:   </clock>
Oct 25 16:40:42 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:40:42 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:40:42 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:40:42 user nova-compute[74048]:   </cpu>
Oct 25 16:40:42 user nova-compute[74048]:   <devices>
Oct 25 16:40:42 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:40:42 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:40:42 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk"/>
Oct 25 16:40:42 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:40:42 user nova-compute[74048]:     </disk>
Oct 25 16:40:42 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:40:42 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:40:42 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:40:42 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:40:42 user nova-compute[74048]:       <serial>9a7ae9af-5c37-49be-8385-4ac04dc8c8e1</serial>
Oct 25 16:40:42 user nova-compute[74048]:     </disk>
Oct 25 16:40:42 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:40:42 user nova-compute[74048]:       <mac address="fa:16:3e:c1:c0:a3"/>
Oct 25 16:40:42 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:40:42 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:40:42 user nova-compute[74048]:       <target dev="tapb225761b-69"/>
Oct 25 16:40:42 user nova-compute[74048]:     </interface>
Oct 25 16:40:42 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:40:42 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/console.log" append="off"/>
Oct 25 16:40:42 user nova-compute[74048]:     </serial>
Oct 25 16:40:42 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:40:42 user nova-compute[74048]:     <video>
Oct 25 16:40:42 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:40:42 user nova-compute[74048]:     </video>
Oct 25 16:40:42 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:40:42 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:40:42 user nova-compute[74048]:     </rng>
Oct 25 16:40:42 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:40:42 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:40:42 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:40:42 user nova-compute[74048]:     </memballoon>
Oct 25 16:40:42 user nova-compute[74048]:   </devices>
Oct 25 16:40:42 user nova-compute[74048]: </domain>
Oct 25 16:40:42 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-373174631-network", "vif_mac": "fa:16:3e:c1:c0:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG os_vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be27a5a-8134-5132-9a59-00c3b78764f4', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb225761b-69, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb225761b-69, col_values=(('qos', UUID('25c71e90-b6de-444e-b7b2-c0b246602d50')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb225761b-69, col_values=(('external_ids', {'iface-id': 'b225761b-69af-459c-ad4e-8901ba049969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c0:a3', 'vm-uuid': '7f739b1f-87a3-4521-bf08-c3b395fb0d44'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:42 user nova-compute[74048]: INFO os_vif [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69')
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] No VIF found with MAC fa:16:3e:c1:c0:a3, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:40:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-86e54075-ff56-4468-81ae-dcbe138b6178 req-e75560c9-1a8e-476a-9926-9047cff3269e service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-86e54075-ff56-4468-81ae-dcbe138b6178 req-e75560c9-1a8e-476a-9926-9047cff3269e service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-86e54075-ff56-4468-81ae-dcbe138b6178 req-e75560c9-1a8e-476a-9926-9047cff3269e service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-86e54075-ff56-4468-81ae-dcbe138b6178 req-e75560c9-1a8e-476a-9926-9047cff3269e service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-86e54075-ff56-4468-81ae-dcbe138b6178 req-e75560c9-1a8e-476a-9926-9047cff3269e service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:44 user nova-compute[74048]: WARNING nova.compute.manager [req-86e54075-ff56-4468-81ae-dcbe138b6178 req-e75560c9-1a8e-476a-9926-9047cff3269e service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state active and task_state resize_finish.
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:45 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:40:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance running successfully.
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Failed to set time: agent not configured {{(pid=74048) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-124a35d3-d884-485d-9273-bebd41f1d7f8 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] finish_migration finished successfully. {{(pid=74048) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [{"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-ed271afb-bdb0-418f-b759-ad86ea0a79a0" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-dd0d2a26-b7c5-4c52-b40d-e69b5be171a7 req-c507f0c1-86d2-406a-b85f-42183ae19990 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dd0d2a26-b7c5-4c52-b40d-e69b5be171a7 req-c507f0c1-86d2-406a-b85f-42183ae19990 service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dd0d2a26-b7c5-4c52-b40d-e69b5be171a7 req-c507f0c1-86d2-406a-b85f-42183ae19990 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dd0d2a26-b7c5-4c52-b40d-e69b5be171a7 req-c507f0c1-86d2-406a-b85f-42183ae19990 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-dd0d2a26-b7c5-4c52-b40d-e69b5be171a7 req-c507f0c1-86d2-406a-b85f-42183ae19990 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:46 user nova-compute[74048]: WARNING nova.compute.manager [req-dd0d2a26-b7c5-4c52-b40d-e69b5be171a7 req-c507f0c1-86d2-406a-b85f-42183ae19990 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state active and task_state resize_finish.
Oct 25 16:40:46 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:47 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:40:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:52 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:40:52 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:40:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=25.016002655029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-changed-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Refreshing instance network info cache due to event network-changed-2f612d84-7ced-4714-b58a-1cd940bf89e6. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] Acquiring lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] Acquired lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG nova.network.neutron [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Refreshing network info cache for port 2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:40:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Applying migration context for instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 as it has an incoming, in-progress migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39. Migration status is finished {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 16:40:52 user nova-compute[74048]: INFO nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating resource usage from migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 761fc401-6c6a-4d05-91e5-875c54b27e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 32eb3254-db05-4a3f-a880-80f3757f0676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updated VIF entry in instance network info cache for port 2f612d84-7ced-4714-b58a-1cd940bf89e6. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updating instance_info_cache with network_info: [{"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0a5c5216-4be0-409f-a8bd-9bbe90a0a75f req-8dbcf339-9460-45d7-9fb7-1b8ea9cfda38 service nova] Releasing lock "refresh_cache-761fc401-6c6a-4d05-91e5-875c54b27e39" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.819s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:40:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:57 user nova-compute[74048]: INFO nova.compute.manager [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Terminating instance
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-cfb7ede9-6e27-4fab-8e62-a9bcf5b238fd req-a249c5c8-be3d-4aa9-9652-7907be5d6885 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cfb7ede9-6e27-4fab-8e62-a9bcf5b238fd req-a249c5c8-be3d-4aa9-9652-7907be5d6885 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cfb7ede9-6e27-4fab-8e62-a9bcf5b238fd req-a249c5c8-be3d-4aa9-9652-7907be5d6885 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-cfb7ede9-6e27-4fab-8e62-a9bcf5b238fd req-a249c5c8-be3d-4aa9-9652-7907be5d6885 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-cfb7ede9-6e27-4fab-8e62-a9bcf5b238fd req-a249c5c8-be3d-4aa9-9652-7907be5d6885 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-cfb7ede9-6e27-4fab-8e62-a9bcf5b238fd req-a249c5c8-be3d-4aa9-9652-7907be5d6885 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-unplugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:40:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Instance destroyed successfully.
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lazy-loading 'resources' on Instance uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-385805206',display_name='tempest-ServerStableDeviceRescueTest-server-385805206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-385805206',id=22,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsc1tXpqwtR2rS24hEi1/EO3kDqyp7qx2H7g98JNtlfkpRqSHHwild/rwLwUnnYeQsqbDKMA/Li2sJWTYVskmur2vnztyca6Jo0k0m6IPCIdx7QjAhjvrW4va6gh3s15A==',key_name='tempest-keypair-1484637459',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a44a4b9a261c4765901e177879113b75',ramdisk_id='',reservation_id='r-wskb0uet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-16526362',owner_user_name='tempest-ServerStableDeviceRescueTest-16526362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce6cca46ca1142e7b9755e80e76e853e',uuid=ed271afb-bdb0-418f-b759-ad86ea0a79a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converting VIF {"id": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "address": "fa:16:3e:42:51:6d", "network": {"id": "7be6cb49-66ff-4c27-8485-2217975609f9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1181841763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a44a4b9a261c4765901e177879113b75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87afd20-35", "ovs_interfaceid": "a87afd20-35e1-40f8-81e2-ad3964a04feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG os_vif [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa87afd20-35, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3299a1f1-10bc-43bc-a876-de3e63147d26) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:57 user nova-compute[74048]: INFO os_vif [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:51:6d,bridge_name='br-int',has_traffic_filtering=True,id=a87afd20-35e1-40f8-81e2-ad3964a04feb,network=Network(7be6cb49-66ff-4c27-8485-2217975609f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87afd20-35')
Oct 25 16:40:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Deleting instance files /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0_del
Oct 25 16:40:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Deletion of /opt/stack/data/nova/instances/ed271afb-bdb0-418f-b759-ad86ea0a79a0_del complete
Oct 25 16:40:57 user nova-compute[74048]: INFO nova.compute.manager [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 25 16:40:57 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:40:57 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:58 user nova-compute[74048]: INFO nova.compute.manager [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Terminating instance
Oct 25 16:40:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-fabe0484-3a8c-4119-a6ef-21cec229742b req-01d799fb-36bd-4d43-9b0f-cb268349616e service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-deleted-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:58 user nova-compute[74048]: INFO nova.compute.manager [req-fabe0484-3a8c-4119-a6ef-21cec229742b req-01d799fb-36bd-4d43-9b0f-cb268349616e service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Neutron deleted interface a87afd20-35e1-40f8-81e2-ad3964a04feb; detaching it from the instance and deleting it from the info cache
Oct 25 16:40:58 user nova-compute[74048]: DEBUG nova.network.neutron [req-fabe0484-3a8c-4119-a6ef-21cec229742b req-01d799fb-36bd-4d43-9b0f-cb268349616e service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:40:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-fabe0484-3a8c-4119-a6ef-21cec229742b req-01d799fb-36bd-4d43-9b0f-cb268349616e service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Detach interface failed, port_id=a87afd20-35e1-40f8-81e2-ad3964a04feb, reason: Instance ed271afb-bdb0-418f-b759-ad86ea0a79a0 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:40:58 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Took 0.99 seconds to deallocate network for instance.
Oct 25 16:40:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: WARNING nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid d587e48c-2104-4f0b-a12c-7334a63d3d5f {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 4a970e43-ae6e-46fc-a5e7-173012590ca7 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid ed271afb-bdb0-418f-b759-ad86ea0a79a0 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "54b28e3c-f604-4d30-ac14-805da155813d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "54b28e3c-f604-4d30-ac14-805da155813d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: INFO nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Acquiring lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] No waiting events found dispatching network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:59 user nova-compute[74048]: WARNING nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: ed271afb-bdb0-418f-b759-ad86ea0a79a0] Received unexpected event network-vif-plugged-a87afd20-35e1-40f8-81e2-ad3964a04feb for instance with vm_state deleted and task_state None.
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-unplugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-unplugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-unplugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Acquiring lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] No waiting events found dispatching network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:40:59 user nova-compute[74048]: WARNING nova.compute.manager [req-b5bab9dc-792e-45cc-9bed-e6240a370968 req-8ccf254a-00ef-46f1-afe0-43a0d2bcccd2 service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received unexpected event network-vif-plugged-963fe763-7fca-4fe8-bf4d-a252959c94fd for instance with vm_state active and task_state deleting.
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Deleted allocations for instance ed271afb-bdb0-418f-b759-ad86ea0a79a0
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5008159c-25fe-435e-825d-72214077663b tempest-ServerStableDeviceRescueTest-16526362 tempest-ServerStableDeviceRescueTest-16526362-project-member] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.271s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "ed271afb-bdb0-418f-b759-ad86ea0a79a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:40:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Instance destroyed successfully.
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'resources' on Instance uuid af48ff38-5eaa-4885-839d-bd8b8d6d4de4 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1189844784',display_name='tempest-TestMinimumBasicScenario-server-1189844784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1189844784',id=24,image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWkaTm34IrrFgglBSk7gV/mazK3/QcVgVulSRYqYR4hz9wDbcdq1lllwiVe12fLxOWZ7RAIQTAv2Q1uscbN13y9VKwS0p/aJeGfPI6k23T/gHdXgomJF4gkR+6cXP8plA==',key_name='tempest-TestMinimumBasicScenario-91951899',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-l76sfr2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cdbb05cc-93c4-4cb1-b01f-8bb35a50ab70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:38:14Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=af48ff38-5eaa-4885-839d-bd8b8d6d4de4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "address": "fa:16:3e:cc:19:90", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963fe763-7f", "ovs_interfaceid": "963fe763-7fca-4fe8-bf4d-a252959c94fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG os_vif [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap963fe763-7f, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e35562d-7f9c-4642-bff2-6f7c3b31e8e2) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:40:59 user nova-compute[74048]: INFO os_vif [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:19:90,bridge_name='br-int',has_traffic_filtering=True,id=963fe763-7fca-4fe8-bf4d-a252959c94fd,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963fe763-7f')
Oct 25 16:40:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Deleting instance files /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4_del
Oct 25 16:40:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Deletion of /opt/stack/data/nova/instances/af48ff38-5eaa-4885-839d-bd8b8d6d4de4_del complete
Oct 25 16:40:59 user nova-compute[74048]: INFO nova.compute.manager [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 25 16:40:59 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:40:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG nova.objects.instance [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:00 user nova-compute[74048]: INFO nova.compute.manager [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Attaching volume 0e7b98f7-b961-420f-bdd8-924841360df3 to /dev/vdb
Oct 25 16:41:00 user nova-compute[74048]: DEBUG os_brick.utils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafe9642-b27c-4b98-bd64-332bab038094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[505032c5-4749-48db-bf20-fccde85ccb1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7159e01-d819-459f-8728-34f25137b529]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61e0ff6-11f0-4250-a2dd-a675b777bb10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:41:00 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[158730b8-811a-43e9-8f21-234e40473cd5]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG os_brick.utils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updating existing volume attachment record: c97c857c-2276-4cca-88bf-1699e41a9c74 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:00 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Took 0.63 seconds to deallocate network for instance.
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-eb378e6f-3dbe-4afd-b995-5b2e7095d4f5 req-2467fa20-818b-4072-b73e-aa377008bc4c service nova] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] Received event network-vif-deleted-963fe763-7fca-4fe8-bf4d-a252959c94fd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:00 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Deleted allocations for instance af48ff38-5eaa-4885-839d-bd8b8d6d4de4
Oct 25 16:41:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e7dcae69-aaaa-4f72-bdf5-4e3e78014f5e tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.667s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:01 user nova-compute[74048]: INFO nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: af48ff38-5eaa-4885-839d-bd8b8d6d4de4] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 25 16:41:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "af48ff38-5eaa-4885-839d-bd8b8d6d4de4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "b5e77341-b320-41e8-aa75-f74052b893cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:41:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:03 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:41:03 user nova-compute[74048]: INFO nova.compute.claims [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Claim successful on node user
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:41:04 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.policy [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a2170a4f3e541bea8147fbf3bc6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412dd65efab430eb361b71f048d3575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:41:04 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Creating image(s)
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk 1073741824" returned: 0 in 0.060s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Successfully created port: 38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Cannot resize image /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Ensure instance console log exists: /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Successfully updated port: 38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-changed-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Refreshing instance network info cache due to event network-changed-38554701-fd40-43e2-94e4-42839020572c. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:41:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] Acquiring lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Updating instance_info_cache with network_info: [{"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Instance network_info: |[{"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] Acquired lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.neutron [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Refreshing network info cache for port 38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Start _get_guest_xml network_info=[{"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:41:06 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:41:06 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1212154774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1212154774',id=30,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-e3zwtwci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:41:05Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=b5e77341-b320-41e8-aa75-f74052b893cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.objects.instance [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'pci_devices' on Instance uuid b5e77341-b320-41e8-aa75-f74052b893cb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:41:06 user nova-compute[74048]:   <uuid>b5e77341-b320-41e8-aa75-f74052b893cb</uuid>
Oct 25 16:41:06 user nova-compute[74048]:   <name>instance-0000001e</name>
Oct 25 16:41:06 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:41:06 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:41:06 user nova-compute[74048]:   <metadata>
Oct 25 16:41:06 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:41:06 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:41:06 user nova-compute[74048]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1212154774</nova:name>
Oct 25 16:41:06 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:41:06</nova:creationTime>
Oct 25 16:41:06 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:41:06 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:41:06 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:41:06 user nova-compute[74048]:       <nova:owner>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:user uuid="6a2170a4f3e541bea8147fbf3bc6b746">tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member</nova:user>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:project uuid="4412dd65efab430eb361b71f048d3575">tempest-ServerBootFromVolumeStableRescueTest-399579320</nova:project>
Oct 25 16:41:06 user nova-compute[74048]:       </nova:owner>
Oct 25 16:41:06 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:41:06 user nova-compute[74048]:       <nova:ports>
Oct 25 16:41:06 user nova-compute[74048]:         <nova:port uuid="38554701-fd40-43e2-94e4-42839020572c">
Oct 25 16:41:06 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 16:41:06 user nova-compute[74048]:         </nova:port>
Oct 25 16:41:06 user nova-compute[74048]:       </nova:ports>
Oct 25 16:41:06 user nova-compute[74048]:     </nova:instance>
Oct 25 16:41:06 user nova-compute[74048]:   </metadata>
Oct 25 16:41:06 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:41:06 user nova-compute[74048]:     <system>
Oct 25 16:41:06 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:41:06 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:41:06 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:41:06 user nova-compute[74048]:       <entry name="serial">b5e77341-b320-41e8-aa75-f74052b893cb</entry>
Oct 25 16:41:06 user nova-compute[74048]:       <entry name="uuid">b5e77341-b320-41e8-aa75-f74052b893cb</entry>
Oct 25 16:41:06 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:41:06 user nova-compute[74048]:     </system>
Oct 25 16:41:06 user nova-compute[74048]:   </sysinfo>
Oct 25 16:41:06 user nova-compute[74048]:   <os>
Oct 25 16:41:06 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:41:06 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:41:06 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:41:06 user nova-compute[74048]:   </os>
Oct 25 16:41:06 user nova-compute[74048]:   <features>
Oct 25 16:41:06 user nova-compute[74048]:     <acpi/>
Oct 25 16:41:06 user nova-compute[74048]:     <apic/>
Oct 25 16:41:06 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:41:06 user nova-compute[74048]:   </features>
Oct 25 16:41:06 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:41:06 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:41:06 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:41:06 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:41:06 user nova-compute[74048]:   </clock>
Oct 25 16:41:06 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:41:06 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:41:06 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:41:06 user nova-compute[74048]:   </cpu>
Oct 25 16:41:06 user nova-compute[74048]:   <devices>
Oct 25 16:41:06 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:41:06 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:41:06 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk"/>
Oct 25 16:41:06 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:41:06 user nova-compute[74048]:     </disk>
Oct 25 16:41:06 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:41:06 user nova-compute[74048]:       <mac address="fa:16:3e:57:2f:6a"/>
Oct 25 16:41:06 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:41:06 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:41:06 user nova-compute[74048]:       <target dev="tap38554701-fd"/>
Oct 25 16:41:06 user nova-compute[74048]:     </interface>
Oct 25 16:41:06 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:41:06 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/console.log" append="off"/>
Oct 25 16:41:06 user nova-compute[74048]:     </serial>
Oct 25 16:41:06 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:41:06 user nova-compute[74048]:     <video>
Oct 25 16:41:06 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:41:06 user nova-compute[74048]:     </video>
Oct 25 16:41:06 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:41:06 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:41:06 user nova-compute[74048]:     </rng>
Oct 25 16:41:06 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:41:06 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:41:06 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:41:06 user nova-compute[74048]:     </memballoon>
Oct 25 16:41:06 user nova-compute[74048]:   </devices>
Oct 25 16:41:06 user nova-compute[74048]: </domain>
Oct 25 16:41:06 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1212154774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1212154774',id=30,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-e3zwtwci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:41:05Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=b5e77341-b320-41e8-aa75-f74052b893cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG os_vif [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bbd8b84-44db-5cf5-8168-3ad60b55a00b', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38554701-fd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38554701-fd, col_values=(('qos', UUID('b57f3def-4056-4148-a6d9-893c718258b4')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38554701-fd, col_values=(('external_ids', {'iface-id': '38554701-fd40-43e2-94e4-42839020572c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:2f:6a', 'vm-uuid': 'b5e77341-b320-41e8-aa75-f74052b893cb'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:06 user nova-compute[74048]: INFO os_vif [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd')
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No VIF found with MAC fa:16:3e:57:2f:6a, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.neutron [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Updated VIF entry in instance network info cache for port 38554701-fd40-43e2-94e4-42839020572c. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG nova.network.neutron [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Updating instance_info_cache with network_info: [{"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b127beed-fe40-40f7-acc6-d32f733d79af req-cc856388-afeb-4b78-96f5-6d90e57e22cd service nova] Releasing lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-a295ad90-48ca-4882-af63-15b6ce524ab5 req-da462527-edd8-4d9e-8aac-a8bfbb17aa88 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a295ad90-48ca-4882-af63-15b6ce524ab5 req-da462527-edd8-4d9e-8aac-a8bfbb17aa88 service nova] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a295ad90-48ca-4882-af63-15b6ce524ab5 req-da462527-edd8-4d9e-8aac-a8bfbb17aa88 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a295ad90-48ca-4882-af63-15b6ce524ab5 req-da462527-edd8-4d9e-8aac-a8bfbb17aa88 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-a295ad90-48ca-4882-af63-15b6ce524ab5 req-da462527-edd8-4d9e-8aac-a8bfbb17aa88 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] No waiting events found dispatching network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:08 user nova-compute[74048]: WARNING nova.compute.manager [req-a295ad90-48ca-4882-af63-15b6ce524ab5 req-da462527-edd8-4d9e-8aac-a8bfbb17aa88 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received unexpected event network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c for instance with vm_state building and task_state spawning.
Oct 25 16:41:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:41:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Instance spawned successfully.
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:10 user nova-compute[74048]: INFO nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 25 16:41:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:41:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-56d371a8-077d-4ed4-94f0-f637f7cca50b req-80025684-ae95-4439-ac7b-de2131980512 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-56d371a8-077d-4ed4-94f0-f637f7cca50b req-80025684-ae95-4439-ac7b-de2131980512 service nova] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-56d371a8-077d-4ed4-94f0-f637f7cca50b req-80025684-ae95-4439-ac7b-de2131980512 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-56d371a8-077d-4ed4-94f0-f637f7cca50b req-80025684-ae95-4439-ac7b-de2131980512 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-56d371a8-077d-4ed4-94f0-f637f7cca50b req-80025684-ae95-4439-ac7b-de2131980512 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] No waiting events found dispatching network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:10 user nova-compute[74048]: WARNING nova.compute.manager [req-56d371a8-077d-4ed4-94f0-f637f7cca50b req-80025684-ae95-4439-ac7b-de2131980512 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received unexpected event network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c for instance with vm_state building and task_state spawning.
Oct 25 16:41:10 user nova-compute[74048]: INFO nova.compute.manager [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Took 6.44 seconds to build instance.
Oct 25 16:41:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-35ff5b76-fe14-42cd-a376-9a1b093b8dcf tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "b5e77341-b320-41e8-aa75-f74052b893cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.545s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGBXRPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:41:18 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:41:18 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:41:18 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[253fd404-e2a7-4b30-9af9-75f6e2cebf61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:41:18 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8611569-dfdf-45da-ba55-3b3a07b7f511]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3] added
Oct 25 16:41:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc2331-c7e4-4350-8654-5f8b8e1cdf97]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f95d424-7811-436c-9d9b-8cd56dc293b0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWGBXRPk {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWGBXRPk" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2e557-62da-448e-b9a3-c5a94c8ece34]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWGBXRPk'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aae1fce-e7cf-4c8a-a442-29f423333ec8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233ebc4-45ce-48be-ac49-16eb4e18887c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab5831-464c-45a9-bf73-9617888b1864]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260]
Oct 25 16:41:18 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260] successful.
Oct 25 16:41:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cb5e2c-f33f-4e97-8b6d-f8be58de80cd]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb2c6d1-a8dc-48bd-9475-7cf0bcbe8ea8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 (non-flash)
Oct 25 16:41:18 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf553e71-9f1c-4e18-9969-71266ec6f693]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:18 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGBXRPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23234393765336566', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234393765336566', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG nova.objects.instance [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:41:19 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:41:19 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:41:19 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:41:19 user nova-compute[74048]:   <serial>0e7b98f7-b961-420f-bdd8-924841360df3</serial>
Oct 25 16:41:19 user nova-compute[74048]: </disk>
Oct 25 16:41:19 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:41:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:41:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:41:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] No VIF found with MAC fa:16:3e:2f:e2:2a, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:41:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ee4203c5-9bd1-4841-89f9-ea2be4fc6968 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.242s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:21 user nova-compute[74048]: INFO nova.compute.manager [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Detaching volume 0e7b98f7-b961-420f-bdd8-924841360df3
Oct 25 16:41:21 user nova-compute[74048]: INFO nova.virt.block_device [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Attempting to driver detach volume 0e7b98f7-b961-420f-bdd8-924841360df3 from mountpoint /dev/vdb
Oct 25 16:41:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Attempting to detach device vdb from instance 761fc401-6c6a-4d05-91e5-875c54b27e39 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:41:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:41:21 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:41:21 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:41:21 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:41:21 user nova-compute[74048]:   <serial>0e7b98f7-b961-420f-bdd8-924841360df3</serial>
Oct 25 16:41:21 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:41:21 user nova-compute[74048]: </disk>
Oct 25 16:41:21 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:41:21 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully detached device vdb from instance 761fc401-6c6a-4d05-91e5-875c54b27e39 from the persistent domain config.
Oct 25 16:41:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 761fc401-6c6a-4d05-91e5-875c54b27e39 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:41:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:41:21 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:41:21 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:41:21 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:41:21 user nova-compute[74048]:   <serial>0e7b98f7-b961-420f-bdd8-924841360df3</serial>
Oct 25 16:41:21 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:41:21 user nova-compute[74048]: </disk>
Oct 25 16:41:21 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:41:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:22 user nova-compute[74048]: INFO nova.compute.manager [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Terminating instance
Oct 25 16:41:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-9797a1f5-1cf0-4c06-b160-3df7e5541869 req-7455646a-f0ce-4402-969b-1841646b0c18 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-unplugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9797a1f5-1cf0-4c06-b160-3df7e5541869 req-7455646a-f0ce-4402-969b-1841646b0c18 service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9797a1f5-1cf0-4c06-b160-3df7e5541869 req-7455646a-f0ce-4402-969b-1841646b0c18 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9797a1f5-1cf0-4c06-b160-3df7e5541869 req-7455646a-f0ce-4402-969b-1841646b0c18 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-9797a1f5-1cf0-4c06-b160-3df7e5541869 req-7455646a-f0ce-4402-969b-1841646b0c18 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-unplugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-9797a1f5-1cf0-4c06-b160-3df7e5541869 req-7455646a-f0ce-4402-969b-1841646b0c18 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-unplugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:41:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Instance destroyed successfully.
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'resources' on Instance uuid 51f3e782-7fc1-4de3-9d74-1d29f3ef9054 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1245678211',display_name='tempest-ServerRescueNegativeTestJSON-server-1245678211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1245678211',id=2,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:26:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-7uvu50qg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:26:31Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=51f3e782-7fc1-4de3-9d74-1d29f3ef9054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "d42debd6-9c21-464b-84ed-1207ba8480bb", "address": "fa:16:3e:70:14:eb", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd42debd6-9c", "ovs_interfaceid": "d42debd6-9c21-464b-84ed-1207ba8480bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG os_vif [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd42debd6-9c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=272b5441-04d0-4e91-bcf2-3f297faafaab) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:23 user nova-compute[74048]: INFO os_vif [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:14:eb,bridge_name='br-int',has_traffic_filtering=True,id=d42debd6-9c21-464b-84ed-1207ba8480bb,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd42debd6-9c')
Oct 25 16:41:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Deleting instance files /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054_del
Oct 25 16:41:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Deletion of /opt/stack/data/nova/instances/51f3e782-7fc1-4de3-9d74-1d29f3ef9054_del complete
Oct 25 16:41:23 user nova-compute[74048]: INFO nova.compute.manager [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 25 16:41:23 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:23 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Took 0.63 seconds to deallocate network for instance.
Oct 25 16:41:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:24 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Deleted allocations for instance 51f3e782-7fc1-4de3-9d74-1d29f3ef9054
Oct 25 16:41:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a8970689-ae2c-441f-97b5-fb11874caa0d tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] Acquiring lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] Lock "51f3e782-7fc1-4de3-9d74-1d29f3ef9054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] No waiting events found dispatching network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:24 user nova-compute[74048]: WARNING nova.compute.manager [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received unexpected event network-vif-plugged-d42debd6-9c21-464b-84ed-1207ba8480bb for instance with vm_state deleted and task_state None.
Oct 25 16:41:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-222fb7f9-5341-4ce2-8806-09861eb1dce1 req-98a6f5d3-3cde-4e03-a38e-a432b24918e8 service nova] [instance: 51f3e782-7fc1-4de3-9d74-1d29f3ef9054] Received event network-vif-deleted-d42debd6-9c21-464b-84ed-1207ba8480bb {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing instance network info cache due to event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG nova.network.neutron [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG nova.network.neutron [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updated VIF entry in instance network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG nova.network.neutron [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a771b95d-de9d-4d48-940a-5ede2e62bacc req-bd1cfae4-66fb-4ba1-8894-4c48172540a1 service nova] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:32 user nova-compute[74048]: INFO nova.compute.manager [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Shelving
Oct 25 16:41:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-4725daae-ed42-4d06-9af4-169e5fdcd1ae req-b743991f-4876-4209-91e4-c93ba30b1a61 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-unplugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4725daae-ed42-4d06-9af4-169e5fdcd1ae req-b743991f-4876-4209-91e4-c93ba30b1a61 service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4725daae-ed42-4d06-9af4-169e5fdcd1ae req-b743991f-4876-4209-91e4-c93ba30b1a61 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4725daae-ed42-4d06-9af4-169e5fdcd1ae req-b743991f-4876-4209-91e4-c93ba30b1a61 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-4725daae-ed42-4d06-9af4-169e5fdcd1ae req-b743991f-4876-4209-91e4-c93ba30b1a61 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-unplugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:33 user nova-compute[74048]: WARNING nova.compute.manager [req-4725daae-ed42-4d06-9af4-169e5fdcd1ae req-b743991f-4876-4209-91e4-c93ba30b1a61 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-unplugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state active and task_state shelving.
Oct 25 16:41:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance destroyed successfully.
Oct 25 16:41:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Beginning cold snapshot process
Oct 25 16:41:33 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:41:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk /opt/stack/data/nova/instances/snapshots/tmpj2rnc9pq/ad4faf3790b14da2b990c9920f9e66ea {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:34 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk /opt/stack/data/nova/instances/snapshots/tmpj2rnc9pq/ad4faf3790b14da2b990c9920f9e66ea" returned: 0 in 0.824s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:34 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Snapshot extracted, beginning image upload
Oct 25 16:41:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-46ba4fd2-28d5-4802-968f-a27d4f0a7176 req-b890ff5f-48b6-4e11-920d-627080f51665 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-46ba4fd2-28d5-4802-968f-a27d4f0a7176 req-b890ff5f-48b6-4e11-920d-627080f51665 service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-46ba4fd2-28d5-4802-968f-a27d4f0a7176 req-b890ff5f-48b6-4e11-920d-627080f51665 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-46ba4fd2-28d5-4802-968f-a27d4f0a7176 req-b890ff5f-48b6-4e11-920d-627080f51665 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-46ba4fd2-28d5-4802-968f-a27d4f0a7176 req-b890ff5f-48b6-4e11-920d-627080f51665 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:35 user nova-compute[74048]: WARNING nova.compute.manager [req-46ba4fd2-28d5-4802-968f-a27d4f0a7176 req-b890ff5f-48b6-4e11-920d-627080f51665 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 16:41:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Snapshot image upload complete
Oct 25 16:41:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:41:37 user nova-compute[74048]: INFO nova.compute.manager [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Shelve offloading
Oct 25 16:41:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance destroyed successfully.
Oct 25 16:41:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:41:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:41:37 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance destroyed successfully.
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'resources' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804756607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804756607',id=29,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNbVnkdtNdNw8mJMazZxYiak8LlGr87f9Wl9L056mc/2DvMhhEQ79Hfh5KiTQ0ly8vgBLYp5ed6qLOGZgmPoB36An89liZ7jiiyCDPLLvgC5Of19DBrwWuaEINZGZRJGg==',key_name='tempest-keypair-179865634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-j67ek4e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member',shelved_at='2023-10-25T16:41:37.097372',shelved_host='user',shelved_image_id='c9de2253-7fb7-420a-a904-e0b4282c1d31'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=32eb3254-db05-4a3f-a880-80f3757f0676,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG os_vif [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b442979-bc, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b1505a-0ee9-4e81-8289-5ce2b07e4732) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:38 user nova-compute[74048]: INFO os_vif [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc')
Oct 25 16:41:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Deleting instance files /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676_del
Oct 25 16:41:38 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Deletion of /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676_del complete
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.compute.manager [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing instance network info cache due to event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:41:38 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Deleted allocations for instance 32eb3254-db05-4a3f-a880-80f3757f0676
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'numa_topology' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.objects.base [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<32eb3254-db05-4a3f-a880-80f3757f0676> lazy-loaded attributes: resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updated VIF entry in instance network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG nova.network.neutron [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5b442979-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d8b5eee6-9a88-4900-883e-48798d53e429 req-0260d242-2c4c-4c8c-a44a-6731013798e1 service nova] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fd37a4a3-4e25-42f0-84fa-0ad80274a662 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.850s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:41 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 761fc401-6c6a-4d05-91e5-875c54b27e39 is timed out.
Oct 25 16:41:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully detached device vdb from instance 761fc401-6c6a-4d05-91e5-875c54b27e39 from the live domain config.
Oct 25 16:41:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGBXRPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:41:41 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cf5221-bb8c-4d53-8b02-b84f2483dac3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:41:41 user nova-compute[74048]: No targets found.
Oct 25 16:41:41 user nova-compute[74048]: iSNS:
Oct 25 16:41:41 user nova-compute[74048]: No targets found.
Oct 25 16:41:41 user nova-compute[74048]: STATIC:
Oct 25 16:41:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1
Oct 25 16:41:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:41:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:41:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:41:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:41:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:41:41 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3
Oct 25 16:41:41 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:41:41 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:41:41 user nova-compute[74048]: FIRMWARE:
Oct 25 16:41:41 user nova-compute[74048]: No targets found.
Oct 25 16:41:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:41:41 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:41:41 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b898c-7153-4606-9a3a-8f20002c8914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3c862b-294f-4166-98c2-878a741a61af]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:41:41 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:41:41 user nova-compute[74048]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 (non-flash)
Oct 25 16:41:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:41:41 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:41:41 user nova-compute[74048]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 (non-flash)
Oct 25 16:41:41 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840549090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:41:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[511cd0ac-d99b-4010-8448-2fa3d5e37353]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ea7ae-2cad-4352-84b9-0190a4fe0c79]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a1438-d8f5-454e-968e-e990c1c971ad]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea91f8c6-136f-41e5-8647-c18e6eee7f65]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7e2598-7278-4c61-b08e-c9887b6216b0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14eb8df-a4ed-4dab-a6e7-6dffe15b355a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260]
Oct 25 16:41:42 user nova-compute[74048]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3, portal: 172.16.0.220,3260] successful.
Oct 25 16:41:42 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e7b98f7-b961-420f-bdd8-924841360df3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b81762f-d725-47c6-976d-bf94c6c51591]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] <== disconnect_volume: return (340ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:41:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'flavor' on Instance uuid 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9eef9aaa-7ff3-4d19-bb4d-b8ff8120fe34 tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:45 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:41:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:46 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:41:46 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:41:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:48 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:41:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:41:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:41:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:41:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7972MB free_disk=25.144630432128906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:41:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Applying migration context for instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 as it has an incoming, in-progress migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39. Migration status is finished {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 16:41:52 user nova-compute[74048]: INFO nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating resource usage from migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f436dc02-f6f1-4e54-8d87-608a462a107c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 761fc401-6c6a-4d05-91e5-875c54b27e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:41:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:41:53 user nova-compute[74048]: INFO nova.compute.claims [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Claim successful on node user
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:41:53 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.policy [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50155e9b8e7d472882d4fcd6d84acfd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242b649ca85c446d84b89b770c703c47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:41:53 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Creating image(s)
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "/opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "/opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "955c49baa5630cee9b154897de59132c69f52974" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "955c49baa5630cee9b154897de59132c69f52974" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Successfully created port: 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG nova.virt.images [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] a18f5d33-9f78-4c9f-98b4-85ea5b650809 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:41:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.part /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.part /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.converted" returned: 0 in 0.279s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "955c49baa5630cee9b154897de59132c69f52974" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.262s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Successfully updated port: 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-changed-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing instance network info cache due to event network-changed-8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "955c49baa5630cee9b154897de59132c69f52974" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "955c49baa5630cee9b154897de59132c69f52974" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974,backing_fmt=raw /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974,backing_fmt=raw /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk 1073741824" returned: 0 in 0.055s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "955c49baa5630cee9b154897de59132c69f52974" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance network_info: |[{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing network info cache for port 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:41:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Cannot resize image /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Ensure instance console log exists: /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Start _get_guest_xml network_info=[{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:41:50Z,direct_url=<?>,disk_format='qcow2',id=a18f5d33-9f78-4c9f-98b4-85ea5b650809,min_disk=0,min_ram=0,name='tempest-scenario-img--1686905242',owner='242b649ca85c446d84b89b770c703c47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:41:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': 'a18f5d33-9f78-4c9f-98b4-85ea5b650809'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:41:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:41:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:41:50Z,direct_url=<?>,disk_format='qcow2',id=a18f5d33-9f78-4c9f-98b4-85ea5b650809,min_disk=0,min_ram=0,name='tempest-scenario-img--1686905242',owner='242b649ca85c446d84b89b770c703c47',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:41:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1867684160',display_name='tempest-TestMinimumBasicScenario-server-1867684160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1867684160',id=31,image_ref='a18f5d33-9f78-4c9f-98b4-85ea5b650809',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe/rYMBSVCOewy3/RO1KXnxfgAa17smF44zhr27738pZPBhBcMsFbfgrLYmxkqEJHYsNI1a8IIm4KEBa+lQR4EYvONtycs87TDIdYhN/t2KzPmqmObVEPDzUtRigunDVg==',key_name='tempest-TestMinimumBasicScenario-1178096365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-0h716837',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a18f5d33-9f78-4c9f-98b4-85ea5b650809',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:41:54Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=f0ef0c4d-5dc2-4593-842b-9afede760abb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'pci_devices' on Instance uuid f0ef0c4d-5dc2-4593-842b-9afede760abb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updated VIF entry in instance network info cache for port 8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:41:56 user nova-compute[74048]:   <uuid>f0ef0c4d-5dc2-4593-842b-9afede760abb</uuid>
Oct 25 16:41:56 user nova-compute[74048]:   <name>instance-0000001f</name>
Oct 25 16:41:56 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:41:56 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:41:56 user nova-compute[74048]:   <metadata>
Oct 25 16:41:56 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:41:56 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:41:56 user nova-compute[74048]:       <nova:name>tempest-TestMinimumBasicScenario-server-1867684160</nova:name>
Oct 25 16:41:56 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:41:56</nova:creationTime>
Oct 25 16:41:56 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:41:56 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:41:56 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:41:56 user nova-compute[74048]:       <nova:owner>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:user uuid="50155e9b8e7d472882d4fcd6d84acfd1">tempest-TestMinimumBasicScenario-323418568-project-member</nova:user>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:project uuid="242b649ca85c446d84b89b770c703c47">tempest-TestMinimumBasicScenario-323418568</nova:project>
Oct 25 16:41:56 user nova-compute[74048]:       </nova:owner>
Oct 25 16:41:56 user nova-compute[74048]:       <nova:root type="image" uuid="a18f5d33-9f78-4c9f-98b4-85ea5b650809"/>
Oct 25 16:41:56 user nova-compute[74048]:       <nova:ports>
Oct 25 16:41:56 user nova-compute[74048]:         <nova:port uuid="8c326348-bc58-4853-a099-536039b55332">
Oct 25 16:41:56 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:41:56 user nova-compute[74048]:         </nova:port>
Oct 25 16:41:56 user nova-compute[74048]:       </nova:ports>
Oct 25 16:41:56 user nova-compute[74048]:     </nova:instance>
Oct 25 16:41:56 user nova-compute[74048]:   </metadata>
Oct 25 16:41:56 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:41:56 user nova-compute[74048]:     <system>
Oct 25 16:41:56 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:41:56 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:41:56 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:41:56 user nova-compute[74048]:       <entry name="serial">f0ef0c4d-5dc2-4593-842b-9afede760abb</entry>
Oct 25 16:41:56 user nova-compute[74048]:       <entry name="uuid">f0ef0c4d-5dc2-4593-842b-9afede760abb</entry>
Oct 25 16:41:56 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:41:56 user nova-compute[74048]:     </system>
Oct 25 16:41:56 user nova-compute[74048]:   </sysinfo>
Oct 25 16:41:56 user nova-compute[74048]:   <os>
Oct 25 16:41:56 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:41:56 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:41:56 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:41:56 user nova-compute[74048]:   </os>
Oct 25 16:41:56 user nova-compute[74048]:   <features>
Oct 25 16:41:56 user nova-compute[74048]:     <acpi/>
Oct 25 16:41:56 user nova-compute[74048]:     <apic/>
Oct 25 16:41:56 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:41:56 user nova-compute[74048]:   </features>
Oct 25 16:41:56 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:41:56 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:41:56 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:41:56 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:41:56 user nova-compute[74048]:   </clock>
Oct 25 16:41:56 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:41:56 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:41:56 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:41:56 user nova-compute[74048]:   </cpu>
Oct 25 16:41:56 user nova-compute[74048]:   <devices>
Oct 25 16:41:56 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:41:56 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:41:56 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk"/>
Oct 25 16:41:56 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:41:56 user nova-compute[74048]:     </disk>
Oct 25 16:41:56 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:41:56 user nova-compute[74048]:       <mac address="fa:16:3e:10:13:cc"/>
Oct 25 16:41:56 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:41:56 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:41:56 user nova-compute[74048]:       <target dev="tap8c326348-bc"/>
Oct 25 16:41:56 user nova-compute[74048]:     </interface>
Oct 25 16:41:56 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:41:56 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/console.log" append="off"/>
Oct 25 16:41:56 user nova-compute[74048]:     </serial>
Oct 25 16:41:56 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:41:56 user nova-compute[74048]:     <video>
Oct 25 16:41:56 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:41:56 user nova-compute[74048]:     </video>
Oct 25 16:41:56 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:41:56 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:41:56 user nova-compute[74048]:     </rng>
Oct 25 16:41:56 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:41:56 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:41:56 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:41:56 user nova-compute[74048]:     </memballoon>
Oct 25 16:41:56 user nova-compute[74048]:   </devices>
Oct 25 16:41:56 user nova-compute[74048]: </domain>
Oct 25 16:41:56 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1867684160',display_name='tempest-TestMinimumBasicScenario-server-1867684160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1867684160',id=31,image_ref='a18f5d33-9f78-4c9f-98b4-85ea5b650809',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe/rYMBSVCOewy3/RO1KXnxfgAa17smF44zhr27738pZPBhBcMsFbfgrLYmxkqEJHYsNI1a8IIm4KEBa+lQR4EYvONtycs87TDIdYhN/t2KzPmqmObVEPDzUtRigunDVg==',key_name='tempest-TestMinimumBasicScenario-1178096365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-0h716837',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a18f5d33-9f78-4c9f-98b4-85ea5b650809',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:41:54Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=f0ef0c4d-5dc2-4593-842b-9afede760abb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG os_vif [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '451f6139-4723-51a2-8144-8b46a63e21db', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f6083c7-c27d-44ae-af2f-bb032f18a947 req-d99c5246-7f04-45c8-b95f-5d544c050fd2 service nova] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c326348-bc, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c326348-bc, col_values=(('qos', UUID('b2888fb6-3772-4c60-affb-64dea5698387')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c326348-bc, col_values=(('external_ids', {'iface-id': '8c326348-bc58-4853-a099-536039b55332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:13:cc', 'vm-uuid': 'f0ef0c4d-5dc2-4593-842b-9afede760abb'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:56 user nova-compute[74048]: INFO os_vif [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc')
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No VIF found with MAC fa:16:3e:10:13:cc, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:41:56 user nova-compute[74048]: INFO nova.compute.claims [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Claim successful on node user
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.network.neutron [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:41:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.policy [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef034e25bba42e78a18c07c4e7ec3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2facb7bd1f4b47149df26f9494f180ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:41:57 user nova-compute[74048]: INFO nova.virt.block_device [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Booting with volume 1ee842f5-d771-40cc-806a-f66a46b615dd at /dev/vda
Oct 25 16:41:57 user nova-compute[74048]: DEBUG os_brick.utils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6b6c4b-2bd6-4c6b-8e88-c5d50c1300ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdb0fe0-7fca-4ede-b30a-b6be241b64bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a2f7d4-670a-4b85-ba30-c77b411c9f44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ec6d2-4a3d-4a11-857a-b09bbc15e3e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:41:57 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[af19844f-6765-44fa-9483-453d7ac5ea77]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG os_brick.utils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updating existing volume attachment record: 44b5f651-64a6-4575-9bce-b5a1d8aebaf6 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-41128a58-665c-4650-9dc1-437574679ea1 req-041fcc1a-6a7d-4133-aaac-f1428665486f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-41128a58-665c-4650-9dc1-437574679ea1 req-041fcc1a-6a7d-4133-aaac-f1428665486f service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-41128a58-665c-4650-9dc1-437574679ea1 req-041fcc1a-6a7d-4133-aaac-f1428665486f service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-41128a58-665c-4650-9dc1-437574679ea1 req-041fcc1a-6a7d-4133-aaac-f1428665486f service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:41:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-41128a58-665c-4650-9dc1-437574679ea1 req-041fcc1a-6a7d-4133-aaac-f1428665486f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:41:57 user nova-compute[74048]: WARNING nova.compute.manager [req-41128a58-665c-4650-9dc1-437574679ea1 req-041fcc1a-6a7d-4133-aaac-f1428665486f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state building and task_state spawning.
Oct 25 16:41:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Successfully created port: f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Successfully updated port: f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquired lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:41:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Port b225761b-69af-459c-ad4e-8901ba049969 binding to destination host user is already ACTIVE {{(pid=74048) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updating instance_info_cache with network_info: [{"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Releasing lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Instance network_info: |[{"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Creating tmpfile /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/tmplndk1ugw to verify with other compute node that the instance is on the same shared storage. {{(pid=74048) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:41:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance spawned successfully.
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:59 user nova-compute[74048]: INFO nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 25 16:41:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:41:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:00 user nova-compute[74048]: WARNING nova.compute.manager [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state building and task_state spawning.
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-changed-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Refreshing instance network info cache due to event network-changed-f46f2238-e9dd-424d-9e20-915915c440ff. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] Acquiring lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] Acquired lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Refreshing network info cache for port f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:42:00 user nova-compute[74048]: INFO nova.compute.manager [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Took 6.75 seconds to build instance.
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cc5b6245-4aa8-4be4-8629-0158e1557a26 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updated VIF entry in instance network info cache for port f46f2238-e9dd-424d-9e20-915915c440ff. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updating instance_info_cache with network_info: [{"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5345a4bd-0d93-493d-b822-4d9e2b6d1016 req-c555cc50-7a6b-4389-9c3a-ec505c4378ed service nova] Releasing lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:42:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance destroyed successfully.
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'resources' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb225761b-69, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25c71e90-b6de-444e-b7b2-c0b246602d50) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: INFO os_vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69')
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:42:00 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc979699-6c58-43d4-ac66-703e108e3f35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:42:00 user nova-compute[74048]: No targets found.
Oct 25 16:42:00 user nova-compute[74048]: iSNS:
Oct 25 16:42:00 user nova-compute[74048]: No targets found.
Oct 25 16:42:00 user nova-compute[74048]: STATIC:
Oct 25 16:42:00 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1
Oct 25 16:42:00 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:42:00 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:42:00 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:42:00 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:42:00 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:42:00 user nova-compute[74048]: FIRMWARE:
Oct 25 16:42:00 user nova-compute[74048]: No targets found.
Oct 25 16:42:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:42:00 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:42:00 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a6be51-5bca-49b7-81ea-85d0b9792464]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c0b20-31ad-47b2-8e0c-bc10110f8a91]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:00 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:42:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:00 user nova-compute[74048]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:42:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840312170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3b4ad-6924-4334-a239-42c11b949faf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2aff2d-0faa-4b3c-961e-54ebe45ec32a]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3209db9-6184-4e52-ad5a-1b479c58a61f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07f0ea-bc33-4bb0-a80a-9629fac65e31]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ef6bc4-2cc5-4afd-911d-32fe0b134769]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[257be896-81e6-4c32-8ac2-556495ee1a16]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]
Oct 25 16:42:00 user nova-compute[74048]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.
Oct 25 16:42:00 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571622c-518c-4b3f-84e9-17fff872cdf8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== disconnect_volume: return (341ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:42:00 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:02 user nova-compute[74048]: WARNING nova.compute.manager [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state resized and task_state resize_reverting.
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:02 user nova-compute[74048]: WARNING nova.compute.manager [req-8744e3c3-e6de-4acc-be39-ad2d5e7afefb req-184287e3-0bbb-479d-b40f-ec05c496869b service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state resized and task_state resize_reverting.
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'migration_context' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.objects.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Object Instance<7f739b1f-87a3-4521-bf08-c3b395fb0d44> lazy-loaded attributes: resources,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:42:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.510s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:02 user nova-compute[74048]: INFO nova.compute.manager [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Swapping old allocation on dict_keys(['8251593b-3c2f-4879-90c3-e2a310c2e6f2']) held by migration 5f86258e-d5c2-478c-a831-b2b44b4c5f39 for instance
Oct 25 16:42:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Overwriting current allocation {'allocations': {'8251593b-3c2f-4879-90c3-e2a310c2e6f2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 39}}, 'project_id': '2991a6a83b4d420fae14308026933e56', 'user_id': '923326e5c82043a59dc710681f5b75d8', 'consumer_generation': 1} on consumer 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG os_brick.utils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[91450691-a6bf-4abe-a79d-09415bc49bc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441b172-f4ba-4c49-9b57-68ce3d70cca1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f88bf-7648-4e7c-8dd1-32e7bed97185]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312d164-9de5-48d8-9c53-f6005ac93e64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:42:03 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:42:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9926cb7-1dd1-4d9c-a423-0e606fcba013]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:42:03 user nova-compute[74048]: DEBUG os_brick.utils [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:42:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:42:10 user nova-compute[74048]: INFO nova.compute.claims [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Claim successful on node user
Oct 25 16:42:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:42:10 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:42:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:42:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG nova.policy [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df5f905d61744496bfafcdfd3f500896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd43437268443f5aa648d69dc0ad17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:42:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Creating image(s)
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "/opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "/opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk 1073741824" returned: 0 in 0.051s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:11 user nova-compute[74048]: INFO nova.compute.manager [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Terminating instance
Oct 25 16:42:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Successfully created port: ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Cannot resize image /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Ensure instance console log exists: /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Instance destroyed successfully.
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.objects.instance [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lazy-loading 'resources' on Instance uuid 761fc401-6c6a-4d05-91e5-875c54b27e39 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1291716055',display_name='tempest-AttachVolumeNegativeTest-server-1291716055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1291716055',id=28,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf7wPF0KKy+K8D9sWGcTgRAG2Oa1mi8IxfLLRnyO8mik8WS4TLuzd7BRCyv6rTyHBDba7bkdynjK3utphXEyGWfy0VN8SK89t8Mooje1Zb58G3c+0wnrhonLorhHUPYOA==',key_name='tempest-keypair-1713763456',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='add2dbb4f18f41b291725ab0073ebd37',ramdisk_id='',reservation_id='r-dvwd4h6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1660122620',owner_user_name='tempest-AttachVolumeNegativeTest-1660122620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c18414d5c9d7450ca96521eabe2a002d',uuid=761fc401-6c6a-4d05-91e5-875c54b27e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converting VIF {"id": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "address": "fa:16:3e:2f:e2:2a", "network": {"id": "efecfdbe-904a-4726-9b18-3340cc07928a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-308467431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "add2dbb4f18f41b291725ab0073ebd37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f612d84-7c", "ovs_interfaceid": "2f612d84-7ced-4714-b58a-1cd940bf89e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG os_vif [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f612d84-7c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=175f66e4-005c-41a4-bb0a-4ed66b65eece) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:12 user nova-compute[74048]: INFO os_vif [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:e2:2a,bridge_name='br-int',has_traffic_filtering=True,id=2f612d84-7ced-4714-b58a-1cd940bf89e6,network=Network(efecfdbe-904a-4726-9b18-3340cc07928a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f612d84-7c')
Oct 25 16:42:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Deleting instance files /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39_del
Oct 25 16:42:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Deletion of /opt/stack/data/nova/instances/761fc401-6c6a-4d05-91e5-875c54b27e39_del complete
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Successfully updated port: ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquired lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-changed-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Refreshing instance network info cache due to event network-changed-ce511ca1-0e95-4ce5-858c-845276995a73. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] Acquiring lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:42:12 user nova-compute[74048]: INFO nova.compute.manager [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 25 16:42:12 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:42:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:13 user nova-compute[74048]: INFO nova.compute.manager [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Terminating instance
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Updating instance_info_cache with network_info: [{"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Releasing lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Instance network_info: |[{"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] Acquired lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Refreshing network info cache for port ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Start _get_guest_xml network_info=[{"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:42:13 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:13 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1387765298',display_name='tempest-ServersNegativeTestJSON-server-1387765298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1387765298',id=33,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd43437268443f5aa648d69dc0ad17c',ramdisk_id='',reservation_id='r-5z74mz8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069803193',owner_user_name='tempest-ServersNegativeTestJSON-2069803193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:42:11Z,user_data=None,user_id='df5f905d61744496bfafcdfd3f500896',uuid=9bb79d7a-8a82-4ce8-912e-7f28bf8deebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converting VIF {"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:42:13 user nova-compute[74048]:   <uuid>9bb79d7a-8a82-4ce8-912e-7f28bf8deebf</uuid>
Oct 25 16:42:13 user nova-compute[74048]:   <name>instance-00000021</name>
Oct 25 16:42:13 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:42:13 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:42:13 user nova-compute[74048]:   <metadata>
Oct 25 16:42:13 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:42:13 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:42:13 user nova-compute[74048]:       <nova:name>tempest-ServersNegativeTestJSON-server-1387765298</nova:name>
Oct 25 16:42:13 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:42:13</nova:creationTime>
Oct 25 16:42:13 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:42:13 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:42:13 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:42:13 user nova-compute[74048]:       <nova:owner>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:user uuid="df5f905d61744496bfafcdfd3f500896">tempest-ServersNegativeTestJSON-2069803193-project-member</nova:user>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:project uuid="3dd43437268443f5aa648d69dc0ad17c">tempest-ServersNegativeTestJSON-2069803193</nova:project>
Oct 25 16:42:13 user nova-compute[74048]:       </nova:owner>
Oct 25 16:42:13 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:42:13 user nova-compute[74048]:       <nova:ports>
Oct 25 16:42:13 user nova-compute[74048]:         <nova:port uuid="ce511ca1-0e95-4ce5-858c-845276995a73">
Oct 25 16:42:13 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 16:42:13 user nova-compute[74048]:         </nova:port>
Oct 25 16:42:13 user nova-compute[74048]:       </nova:ports>
Oct 25 16:42:13 user nova-compute[74048]:     </nova:instance>
Oct 25 16:42:13 user nova-compute[74048]:   </metadata>
Oct 25 16:42:13 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:42:13 user nova-compute[74048]:     <system>
Oct 25 16:42:13 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:42:13 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:42:13 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:42:13 user nova-compute[74048]:       <entry name="serial">9bb79d7a-8a82-4ce8-912e-7f28bf8deebf</entry>
Oct 25 16:42:13 user nova-compute[74048]:       <entry name="uuid">9bb79d7a-8a82-4ce8-912e-7f28bf8deebf</entry>
Oct 25 16:42:13 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:42:13 user nova-compute[74048]:     </system>
Oct 25 16:42:13 user nova-compute[74048]:   </sysinfo>
Oct 25 16:42:13 user nova-compute[74048]:   <os>
Oct 25 16:42:13 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:42:13 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:42:13 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:42:13 user nova-compute[74048]:   </os>
Oct 25 16:42:13 user nova-compute[74048]:   <features>
Oct 25 16:42:13 user nova-compute[74048]:     <acpi/>
Oct 25 16:42:13 user nova-compute[74048]:     <apic/>
Oct 25 16:42:13 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:42:13 user nova-compute[74048]:   </features>
Oct 25 16:42:13 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:42:13 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:42:13 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:42:13 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:42:13 user nova-compute[74048]:   </clock>
Oct 25 16:42:13 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:42:13 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:42:13 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:42:13 user nova-compute[74048]:   </cpu>
Oct 25 16:42:13 user nova-compute[74048]:   <devices>
Oct 25 16:42:13 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:42:13 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:42:13 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk"/>
Oct 25 16:42:13 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:42:13 user nova-compute[74048]:     </disk>
Oct 25 16:42:13 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:42:13 user nova-compute[74048]:       <mac address="fa:16:3e:d5:e1:75"/>
Oct 25 16:42:13 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:42:13 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:42:13 user nova-compute[74048]:       <target dev="tapce511ca1-0e"/>
Oct 25 16:42:13 user nova-compute[74048]:     </interface>
Oct 25 16:42:13 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:42:13 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/console.log" append="off"/>
Oct 25 16:42:13 user nova-compute[74048]:     </serial>
Oct 25 16:42:13 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:42:13 user nova-compute[74048]:     <video>
Oct 25 16:42:13 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:42:13 user nova-compute[74048]:     </video>
Oct 25 16:42:13 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:42:13 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:42:13 user nova-compute[74048]:     </rng>
Oct 25 16:42:13 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:42:13 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:42:13 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:42:13 user nova-compute[74048]:     </memballoon>
Oct 25 16:42:13 user nova-compute[74048]:   </devices>
Oct 25 16:42:13 user nova-compute[74048]: </domain>
Oct 25 16:42:13 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1387765298',display_name='tempest-ServersNegativeTestJSON-server-1387765298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1387765298',id=33,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd43437268443f5aa648d69dc0ad17c',ramdisk_id='',reservation_id='r-5z74mz8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069803193',owner_user_name='tempest-ServersNegativeTestJSON-2069803193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:42:11Z,user_data=None,user_id='df5f905d61744496bfafcdfd3f500896',uuid=9bb79d7a-8a82-4ce8-912e-7f28bf8deebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converting VIF {"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG os_vif [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b1d3075-24a2-5b67-b49c-cf85ce32097e', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce511ca1-0e, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce511ca1-0e, col_values=(('qos', UUID('e966e275-27d0-48f4-aa94-d64844ee8fb5')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce511ca1-0e, col_values=(('external_ids', {'iface-id': 'ce511ca1-0e95-4ce5-858c-845276995a73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:e1:75', 'vm-uuid': '9bb79d7a-8a82-4ce8-912e-7f28bf8deebf'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:13 user nova-compute[74048]: INFO os_vif [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e')
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] No VIF found with MAC fa:16:3e:d5:e1:75, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-e8b92975-0498-428c-bcd1-349e804915e7 req-70d4b2d6-4f91-43f8-979c-620cf7510686 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-vif-unplugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e8b92975-0498-428c-bcd1-349e804915e7 req-70d4b2d6-4f91-43f8-979c-620cf7510686 service nova] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e8b92975-0498-428c-bcd1-349e804915e7 req-70d4b2d6-4f91-43f8-979c-620cf7510686 service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e8b92975-0498-428c-bcd1-349e804915e7 req-70d4b2d6-4f91-43f8-979c-620cf7510686 service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-e8b92975-0498-428c-bcd1-349e804915e7 req-70d4b2d6-4f91-43f8-979c-620cf7510686 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] No waiting events found dispatching network-vif-unplugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-e8b92975-0498-428c-bcd1-349e804915e7 req-70d4b2d6-4f91-43f8-979c-620cf7510686 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-vif-unplugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Updated VIF entry in instance network info cache for port ce511ca1-0e95-4ce5-858c-845276995a73. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Updating instance_info_cache with network_info: [{"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-734257bf-448d-42c8-9e43-a0179f79d95b req-4dd02031-59aa-4c81-908e-e0fdb5bbd665 service nova] Releasing lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-b945ed04-d632-4c52-9bcd-15a91bc5a735 req-425b8d82-754a-4568-87a1-31f371a6c405 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-vif-deleted-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:13 user nova-compute[74048]: INFO nova.compute.manager [req-b945ed04-d632-4c52-9bcd-15a91bc5a735 req-425b8d82-754a-4568-87a1-31f371a6c405 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Neutron deleted interface 2f612d84-7ced-4714-b58a-1cd940bf89e6; detaching it from the instance and deleting it from the info cache
Oct 25 16:42:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-b945ed04-d632-4c52-9bcd-15a91bc5a735 req-425b8d82-754a-4568-87a1-31f371a6c405 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:13 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Took 1.18 seconds to deallocate network for instance.
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-b945ed04-d632-4c52-9bcd-15a91bc5a735 req-425b8d82-754a-4568-87a1-31f371a6c405 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Detach interface failed, port_id=2f612d84-7ced-4714-b58a-1cd940bf89e6, reason: Instance 761fc401-6c6a-4d05-91e5-875c54b27e39 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:42:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Instance destroyed successfully.
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.objects.instance [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lazy-loading 'resources' on Instance uuid f436dc02-f6f1-4e54-8d87-608a462a107c {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-924952119',display_name='tempest-ServerRescueNegativeTestJSON-server-924952119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-924952119',id=1,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='931f649d6b844bbdaec9f1b97ab1112c',ramdisk_id='',reservation_id='r-uqtezwev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1121503960',owner_user_name='tempest-ServerRescueNegativeTestJSON-1121503960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:31:28Z,user_data=None,user_id='94ff1b26939b49ba88fe0105bec65fc2',uuid=f436dc02-f6f1-4e54-8d87-608a462a107c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converting VIF {"id": "9730b0be-a374-415e-8132-58e629dd7caf", "address": "fa:16:3e:5f:0c:f4", "network": {"id": "c61ccb17-9f94-4d00-8950-e33950a7cff7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-607327956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "931f649d6b844bbdaec9f1b97ab1112c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9730b0be-a3", "ovs_interfaceid": "9730b0be-a374-415e-8132-58e629dd7caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG os_vif [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9730b0be-a3, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32e74f14-620b-4b65-ad45-4ffdae7ed23a) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:14 user nova-compute[74048]: INFO os_vif [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:0c:f4,bridge_name='br-int',has_traffic_filtering=True,id=9730b0be-a374-415e-8132-58e629dd7caf,network=Network(c61ccb17-9f94-4d00-8950-e33950a7cff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9730b0be-a3')
Oct 25 16:42:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Deleting instance files /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c_del
Oct 25 16:42:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Deletion of /opt/stack/data/nova/instances/f436dc02-f6f1-4e54-8d87-608a462a107c_del complete
Oct 25 16:42:14 user nova-compute[74048]: INFO nova.compute.manager [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:14 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Deleted allocations for instance 761fc401-6c6a-4d05-91e5-875c54b27e39
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-32e6fa9c-ec99-4877-989f-515866212a0f tempest-AttachVolumeNegativeTest-1660122620 tempest-AttachVolumeNegativeTest-1660122620-project-member] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:14 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Took 0.55 seconds to deallocate network for instance.
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Deleted allocations for instance f436dc02-f6f1-4e54-8d87-608a462a107c
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-33361dde-bdf0-4dec-9165-368bdbb98ea3 tempest-ServerRescueNegativeTestJSON-1121503960 tempest-ServerRescueNegativeTestJSON-1121503960-project-member] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received event network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Acquiring lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "761fc401-6c6a-4d05-91e5-875c54b27e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] No waiting events found dispatching network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:15 user nova-compute[74048]: WARNING nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 761fc401-6c6a-4d05-91e5-875c54b27e39] Received unexpected event network-vif-plugged-2f612d84-7ced-4714-b58a-1cd940bf89e6 for instance with vm_state deleted and task_state None.
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:15 user nova-compute[74048]: WARNING nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-unplugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state deleted and task_state None.
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Acquiring lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "f436dc02-f6f1-4e54-8d87-608a462a107c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] No waiting events found dispatching network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:15 user nova-compute[74048]: WARNING nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received unexpected event network-vif-plugged-9730b0be-a374-415e-8132-58e629dd7caf for instance with vm_state deleted and task_state None.
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:15 user nova-compute[74048]: WARNING nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state building and task_state spawning.
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:15 user nova-compute[74048]: WARNING nova.compute.manager [req-4f38cb14-20e8-429b-8d6a-37721357de85 req-34bf6b06-94ac-4274-bf05-d9a49d5f7e68 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state building and task_state spawning.
Oct 25 16:42:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-7729ceea-f988-4eb6-9472-ed5b64f2fcd6 req-ffff836e-5a0d-4f9a-b39e-c5d6f53ccd4b service nova] [instance: f436dc02-f6f1-4e54-8d87-608a462a107c] Received event network-vif-deleted-9730b0be-a374-415e-8132-58e629dd7caf {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:42:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Creating image(s)
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Ensure instance console log exists: /opt/stack/data/nova/instances/7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Start _get_guest_xml network_info=[{"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '44b5f651-64a6-4575-9bce-b5a1d8aebaf6', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWcRBPSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec', 'attached_at': '', 'detached_at': '', 'volume_id': '1ee842f5-d771-40cc-806a-f66a46b615dd', 'serial': '1ee842f5-d771-40cc-806a-f66a46b615dd'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:42:16 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:16 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWcRBPSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:42:16 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:42:16 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:42:16 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62a2c5-0109-4e61-93bb-cde3d88798c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:42:16 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db342e-8406-49f6-abad-dbb84e8d60f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd] added
Oct 25 16:42:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fd0766-16a1-4026-91e1-3018bfd8574b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c727a930-8b67-4e79-8872-51b1d8bca965]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWcRBPSd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWcRBPSd" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968e56f-c674-49b3-a23d-eaf670d89a1b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWcRBPSd'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e0a771-5049-447d-befc-6e664575b124]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[93082c24-0f13-49e2-9c39-bdf4cdc5c131]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[85513318-1daa-4c0b-957f-e682d6efadda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260]
Oct 25 16:42:16 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260] successful.
Oct 25 16:42:16 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d70ef-a5b6-4ae2-8f23-3e6c098f0e32]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:16 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f2b682-823b-4b8c-a0d7-d376d38affbb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:17 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:42:17 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:17 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:42:17 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc5a9f-76de-42d2-b2ea-6d5dcfc96102]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWcRBPSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:42:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Instance spawned successfully.
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:17 user nova-compute[74048]: INFO nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 25 16:42:17 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:42:17 user nova-compute[74048]: INFO nova.compute.manager [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Took 7.47 seconds to build instance.
Oct 25 16:42:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4af5f996-34c0-4d7b-918d-34cd2faebc9a tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.603s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23334356533396366', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334356533396366', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-24550678',display_name='tempest-TestVolumeBootPattern-volume-backed-server-24550678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-24550678',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJM9dWEBIUzYBGDn4kD9F/2CVgL9ro0W0qBxdijL9mUDSuMWLRJW/1lHqJlibYq1+kcAWYYFeWNcV/YlN5ZFOSIczOkI9Idw8cg9k0340lDeO5qakqRrPCcQbxhPl4utA==',key_name='tempest-keypair-951836702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-4srjf7nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.objects.instance [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:42:18 user nova-compute[74048]:   <uuid>7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec</uuid>
Oct 25 16:42:18 user nova-compute[74048]:   <name>instance-00000020</name>
Oct 25 16:42:18 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:42:18 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:42:18 user nova-compute[74048]:   <metadata>
Oct 25 16:42:18 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:42:18 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:42:18 user nova-compute[74048]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-24550678</nova:name>
Oct 25 16:42:18 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:42:16</nova:creationTime>
Oct 25 16:42:18 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:42:18 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:42:18 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:42:18 user nova-compute[74048]:       <nova:owner>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:user uuid="0ef034e25bba42e78a18c07c4e7ec3b2">tempest-TestVolumeBootPattern-1454543820-project-member</nova:user>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:project uuid="2facb7bd1f4b47149df26f9494f180ae">tempest-TestVolumeBootPattern-1454543820</nova:project>
Oct 25 16:42:18 user nova-compute[74048]:       </nova:owner>
Oct 25 16:42:18 user nova-compute[74048]:       <nova:ports>
Oct 25 16:42:18 user nova-compute[74048]:         <nova:port uuid="f46f2238-e9dd-424d-9e20-915915c440ff">
Oct 25 16:42:18 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:42:18 user nova-compute[74048]:         </nova:port>
Oct 25 16:42:18 user nova-compute[74048]:       </nova:ports>
Oct 25 16:42:18 user nova-compute[74048]:     </nova:instance>
Oct 25 16:42:18 user nova-compute[74048]:   </metadata>
Oct 25 16:42:18 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:42:18 user nova-compute[74048]:     <system>
Oct 25 16:42:18 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:42:18 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:42:18 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:42:18 user nova-compute[74048]:       <entry name="serial">7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec</entry>
Oct 25 16:42:18 user nova-compute[74048]:       <entry name="uuid">7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec</entry>
Oct 25 16:42:18 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:42:18 user nova-compute[74048]:     </system>
Oct 25 16:42:18 user nova-compute[74048]:   </sysinfo>
Oct 25 16:42:18 user nova-compute[74048]:   <os>
Oct 25 16:42:18 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:42:18 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:42:18 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:42:18 user nova-compute[74048]:   </os>
Oct 25 16:42:18 user nova-compute[74048]:   <features>
Oct 25 16:42:18 user nova-compute[74048]:     <acpi/>
Oct 25 16:42:18 user nova-compute[74048]:     <apic/>
Oct 25 16:42:18 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:42:18 user nova-compute[74048]:   </features>
Oct 25 16:42:18 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:42:18 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:42:18 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:42:18 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:42:18 user nova-compute[74048]:   </clock>
Oct 25 16:42:18 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:42:18 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:42:18 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:42:18 user nova-compute[74048]:   </cpu>
Oct 25 16:42:18 user nova-compute[74048]:   <devices>
Oct 25 16:42:18 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:42:18 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:42:18 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:42:18 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:42:18 user nova-compute[74048]:       <serial>1ee842f5-d771-40cc-806a-f66a46b615dd</serial>
Oct 25 16:42:18 user nova-compute[74048]:     </disk>
Oct 25 16:42:18 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:42:18 user nova-compute[74048]:       <mac address="fa:16:3e:48:66:86"/>
Oct 25 16:42:18 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:42:18 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:42:18 user nova-compute[74048]:       <target dev="tapf46f2238-e9"/>
Oct 25 16:42:18 user nova-compute[74048]:     </interface>
Oct 25 16:42:18 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:42:18 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec/console.log" append="off"/>
Oct 25 16:42:18 user nova-compute[74048]:     </serial>
Oct 25 16:42:18 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:42:18 user nova-compute[74048]:     <video>
Oct 25 16:42:18 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:42:18 user nova-compute[74048]:     </video>
Oct 25 16:42:18 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:42:18 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:42:18 user nova-compute[74048]:     </rng>
Oct 25 16:42:18 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:42:18 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:42:18 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:42:18 user nova-compute[74048]:     </memballoon>
Oct 25 16:42:18 user nova-compute[74048]:   </devices>
Oct 25 16:42:18 user nova-compute[74048]: </domain>
Oct 25 16:42:18 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-24550678',display_name='tempest-TestVolumeBootPattern-volume-backed-server-24550678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-24550678',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJM9dWEBIUzYBGDn4kD9F/2CVgL9ro0W0qBxdijL9mUDSuMWLRJW/1lHqJlibYq1+kcAWYYFeWNcV/YlN5ZFOSIczOkI9Idw8cg9k0340lDeO5qakqRrPCcQbxhPl4utA==',key_name='tempest-keypair-951836702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-4srjf7nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG os_vif [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a304bba6-72fc-5aae-8177-3345260ef741', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf46f2238-e9, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf46f2238-e9, col_values=(('qos', UUID('237e3cee-99e5-47c1-a392-3f504c316a1f')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf46f2238-e9, col_values=(('external_ids', {'iface-id': 'f46f2238-e9dd-424d-9e20-915915c440ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:66:86', 'vm-uuid': '7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:18 user nova-compute[74048]: INFO os_vif [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9')
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:42:18 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No VIF found with MAC fa:16:3e:48:66:86, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-fbc8a20e-fd10-49f6-a545-1145a5802295 req-c9be5849-5c46-4f48-95d6-a382e830a181 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fbc8a20e-fd10-49f6-a545-1145a5802295 req-c9be5849-5c46-4f48-95d6-a382e830a181 service nova] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fbc8a20e-fd10-49f6-a545-1145a5802295 req-c9be5849-5c46-4f48-95d6-a382e830a181 service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fbc8a20e-fd10-49f6-a545-1145a5802295 req-c9be5849-5c46-4f48-95d6-a382e830a181 service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:19 user nova-compute[74048]: DEBUG nova.compute.manager [req-fbc8a20e-fd10-49f6-a545-1145a5802295 req-c9be5849-5c46-4f48-95d6-a382e830a181 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] No waiting events found dispatching network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:19 user nova-compute[74048]: WARNING nova.compute.manager [req-fbc8a20e-fd10-49f6-a545-1145a5802295 req-c9be5849-5c46-4f48-95d6-a382e830a181 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received unexpected event network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff for instance with vm_state building and task_state spawning.
Oct 25 16:42:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-d8914e8b-2cb0-4cdb-acca-63b5efdbc82c req-a981f1de-c30c-4f2d-ac8f-0a5f26670b4a service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d8914e8b-2cb0-4cdb-acca-63b5efdbc82c req-a981f1de-c30c-4f2d-ac8f-0a5f26670b4a service nova] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d8914e8b-2cb0-4cdb-acca-63b5efdbc82c req-a981f1de-c30c-4f2d-ac8f-0a5f26670b4a service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d8914e8b-2cb0-4cdb-acca-63b5efdbc82c req-a981f1de-c30c-4f2d-ac8f-0a5f26670b4a service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-d8914e8b-2cb0-4cdb-acca-63b5efdbc82c req-a981f1de-c30c-4f2d-ac8f-0a5f26670b4a service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] No waiting events found dispatching network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:21 user nova-compute[74048]: WARNING nova.compute.manager [req-d8914e8b-2cb0-4cdb-acca-63b5efdbc82c req-a981f1de-c30c-4f2d-ac8f-0a5f26670b4a service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received unexpected event network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff for instance with vm_state building and task_state spawning.
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:42:21 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Instance spawned successfully.
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:42:22 user nova-compute[74048]: INFO nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Took 5.34 seconds to spawn the instance on the hypervisor.
Oct 25 16:42:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:42:22 user nova-compute[74048]: INFO nova.compute.manager [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Took 25.54 seconds to build instance.
Oct 25 16:42:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-42a8a42d-4505-4071-8a11-8146c9a683b0 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.650s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Starting finish_revert_migration {{(pid=74048) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start _get_guest_xml network_info=[{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '9591ca48-380d-41f1-9e18-54b390e2af8f', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7f739b1f-87a3-4521-bf08-c3b395fb0d44', 'attached_at': '2023-10-25T16:42:23.000000', 'detached_at': '', 'volume_id': '9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'serial': '9a7ae9af-5c37-49be-8385-4ac04dc8c8e1'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:42:23 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:23 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:42:23 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:42:23 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:42:23 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d5ccf-5e63-4133-a65a-4a9109fd98d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:42:23 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d95417-00a2-4870-88ab-976ead6d129a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1] added
Oct 25 16:42:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[af153ab7-3f9c-4279-9e99-1be16c592ce6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b3a649-ca50-4e2f-9b4d-936fffd3dded]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkdJBwOe {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkdJBwOe" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab3f97-652d-47ac-8813-d349c5d93b56]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkdJBwOe'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d1b3f-adbf-4fc0-932e-8c4b40aa9ae3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3c329-1d37-497f-bc03-338cefcec766]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:23 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:42:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:23 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:42:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffbafa7-bf83-40ac-a597-c15c51b3cc19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]
Oct 25 16:42:23 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.
Oct 25 16:42:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fa0369-c4bb-4a6f-b773-e0a5d0e508e2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f14c17-31e4-40e4-a480-350ccaa59aa8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:23 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:42:23 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:42:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:42:23 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:42:23 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:42:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[890437ae-24a7-418d-adbe-9e5be88dcd5b]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:42:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26437333631313531', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437333631313531', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:42:24 user nova-compute[74048]:   <uuid>7f739b1f-87a3-4521-bf08-c3b395fb0d44</uuid>
Oct 25 16:42:24 user nova-compute[74048]:   <name>instance-0000001a</name>
Oct 25 16:42:24 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:42:24 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:42:24 user nova-compute[74048]:   <metadata>
Oct 25 16:42:24 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:42:24 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:42:24 user nova-compute[74048]:       <nova:name>tempest-ServerActionsTestOtherB-server-191961762</nova:name>
Oct 25 16:42:24 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:42:23</nova:creationTime>
Oct 25 16:42:24 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:42:24 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:42:24 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:42:24 user nova-compute[74048]:       <nova:owner>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:user uuid="923326e5c82043a59dc710681f5b75d8">tempest-ServerActionsTestOtherB-2012243518-project-member</nova:user>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:project uuid="2991a6a83b4d420fae14308026933e56">tempest-ServerActionsTestOtherB-2012243518</nova:project>
Oct 25 16:42:24 user nova-compute[74048]:       </nova:owner>
Oct 25 16:42:24 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:42:24 user nova-compute[74048]:       <nova:ports>
Oct 25 16:42:24 user nova-compute[74048]:         <nova:port uuid="b225761b-69af-459c-ad4e-8901ba049969">
Oct 25 16:42:24 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:42:24 user nova-compute[74048]:         </nova:port>
Oct 25 16:42:24 user nova-compute[74048]:       </nova:ports>
Oct 25 16:42:24 user nova-compute[74048]:     </nova:instance>
Oct 25 16:42:24 user nova-compute[74048]:   </metadata>
Oct 25 16:42:24 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:42:24 user nova-compute[74048]:     <system>
Oct 25 16:42:24 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:42:24 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:42:24 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:42:24 user nova-compute[74048]:       <entry name="serial">7f739b1f-87a3-4521-bf08-c3b395fb0d44</entry>
Oct 25 16:42:24 user nova-compute[74048]:       <entry name="uuid">7f739b1f-87a3-4521-bf08-c3b395fb0d44</entry>
Oct 25 16:42:24 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:42:24 user nova-compute[74048]:     </system>
Oct 25 16:42:24 user nova-compute[74048]:   </sysinfo>
Oct 25 16:42:24 user nova-compute[74048]:   <os>
Oct 25 16:42:24 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:42:24 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:42:24 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:42:24 user nova-compute[74048]:   </os>
Oct 25 16:42:24 user nova-compute[74048]:   <features>
Oct 25 16:42:24 user nova-compute[74048]:     <acpi/>
Oct 25 16:42:24 user nova-compute[74048]:     <apic/>
Oct 25 16:42:24 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:42:24 user nova-compute[74048]:   </features>
Oct 25 16:42:24 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:42:24 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:42:24 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:42:24 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:42:24 user nova-compute[74048]:   </clock>
Oct 25 16:42:24 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:42:24 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:42:24 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:42:24 user nova-compute[74048]:   </cpu>
Oct 25 16:42:24 user nova-compute[74048]:   <devices>
Oct 25 16:42:24 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:42:24 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:42:24 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk"/>
Oct 25 16:42:24 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:42:24 user nova-compute[74048]:     </disk>
Oct 25 16:42:24 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:42:24 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:42:24 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:42:24 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:42:24 user nova-compute[74048]:       <serial>9a7ae9af-5c37-49be-8385-4ac04dc8c8e1</serial>
Oct 25 16:42:24 user nova-compute[74048]:     </disk>
Oct 25 16:42:24 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:42:24 user nova-compute[74048]:       <mac address="fa:16:3e:c1:c0:a3"/>
Oct 25 16:42:24 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:42:24 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:42:24 user nova-compute[74048]:       <target dev="tapb225761b-69"/>
Oct 25 16:42:24 user nova-compute[74048]:     </interface>
Oct 25 16:42:24 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:42:24 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/console.log" append="off"/>
Oct 25 16:42:24 user nova-compute[74048]:     </serial>
Oct 25 16:42:24 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:42:24 user nova-compute[74048]:     <video>
Oct 25 16:42:24 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:42:24 user nova-compute[74048]:     </video>
Oct 25 16:42:24 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:42:24 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:42:24 user nova-compute[74048]:     </rng>
Oct 25 16:42:24 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:42:24 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:42:24 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:42:24 user nova-compute[74048]:     </memballoon>
Oct 25 16:42:24 user nova-compute[74048]:   </devices>
Oct 25 16:42:24 user nova-compute[74048]: </domain>
Oct 25 16:42:24 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG os_vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9be27a5a-8134-5132-9a59-00c3b78764f4', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb225761b-69, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb225761b-69, col_values=(('qos', UUID('a317b543-1e41-4055-8272-b2cd1137cb12')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb225761b-69, col_values=(('external_ids', {'iface-id': 'b225761b-69af-459c-ad4e-8901ba049969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c0:a3', 'vm-uuid': '7f739b1f-87a3-4521-bf08-c3b395fb0d44'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:42:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:24 user nova-compute[74048]: INFO os_vif [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69')
Oct 25 16:42:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-73f3841b-fa9b-4fa1-9282-5e9ecbd5362a req-fb891559-28c1-435b-aa12-1d5055db2acc service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f3841b-fa9b-4fa1-9282-5e9ecbd5362a req-fb891559-28c1-435b-aa12-1d5055db2acc service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f3841b-fa9b-4fa1-9282-5e9ecbd5362a req-fb891559-28c1-435b-aa12-1d5055db2acc service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-73f3841b-fa9b-4fa1-9282-5e9ecbd5362a req-fb891559-28c1-435b-aa12-1d5055db2acc service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-73f3841b-fa9b-4fa1-9282-5e9ecbd5362a req-fb891559-28c1-435b-aa12-1d5055db2acc service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:26 user nova-compute[74048]: WARNING nova.compute.manager [req-73f3841b-fa9b-4fa1-9282-5e9ecbd5362a req-fb891559-28c1-435b-aa12-1d5055db2acc service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state resized and task_state resize_reverting.
Oct 25 16:42:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:42:28 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance running successfully.
Oct 25 16:42:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] finish_revert_migration finished successfully. {{(pid=74048) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 25 16:42:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-76125bac-4b3e-4dbd-9dda-1f2fa1b08ae4 req-b77e1d95-f208-49ed-8544-1b4b35a8d9cf service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:42:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-76125bac-4b3e-4dbd-9dda-1f2fa1b08ae4 req-b77e1d95-f208-49ed-8544-1b4b35a8d9cf service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-76125bac-4b3e-4dbd-9dda-1f2fa1b08ae4 req-b77e1d95-f208-49ed-8544-1b4b35a8d9cf service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-76125bac-4b3e-4dbd-9dda-1f2fa1b08ae4 req-b77e1d95-f208-49ed-8544-1b4b35a8d9cf service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-76125bac-4b3e-4dbd-9dda-1f2fa1b08ae4 req-b77e1d95-f208-49ed-8544-1b4b35a8d9cf service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:42:28 user nova-compute[74048]: WARNING nova.compute.manager [req-76125bac-4b3e-4dbd-9dda-1f2fa1b08ae4 req-b77e1d95-f208-49ed-8544-1b4b35a8d9cf service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state resized and task_state resize_reverting.
Oct 25 16:42:28 user nova-compute[74048]: INFO nova.compute.manager [None req-d17c093a-cee9-4c3d-9f7a-1d1cca0f308a tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance to original state: 'active'
Oct 25 16:42:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:41 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:42:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [{"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-7f739b1f-87a3-4521-bf08-c3b395fb0d44" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:48 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:42:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=25.138702392578125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f0ef0c4d-5dc2-4593-842b-9afede760abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:42:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:42:52 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:42:52 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:42:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:42:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:42:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:42:54 user nova-compute[74048]: INFO nova.compute.manager [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] instance snapshotting
Oct 25 16:42:54 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Beginning live snapshot process
Oct 25 16:42:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqu66hqq7/16e6397b0f4e4634b97c416b1b383771.delta 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqu66hqq7/16e6397b0f4e4634b97c416b1b383771.delta 1073741824" returned: 0 in 0.049s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 16:42:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:42:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:42:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] COPY block job progress, current cursor: 47513600 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:42:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:42:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 16:42:57 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:42:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqu66hqq7/16e6397b0f4e4634b97c416b1b383771.delta /opt/stack/data/nova/instances/snapshots/tmpqu66hqq7/16e6397b0f4e4634b97c416b1b383771 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:42:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqu66hqq7/16e6397b0f4e4634b97c416b1b383771.delta /opt/stack/data/nova/instances/snapshots/tmpqu66hqq7/16e6397b0f4e4634b97c416b1b383771" returned: 0 in 0.437s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:42:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Snapshot extracted, beginning image upload
Oct 25 16:42:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Snapshot image upload complete
Oct 25 16:43:00 user nova-compute[74048]: INFO nova.compute.manager [None req-18a2be12-8588-458b-a8ee-4c99fafbc64f tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Took 5.41 seconds to snapshot the instance on the hypervisor.
Oct 25 16:43:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:43:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:25 user nova-compute[74048]: INFO nova.compute.manager [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Unshelving
Oct 25 16:43:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'pci_requests' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'numa_topology' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:25 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:43:25 user nova-compute[74048]: INFO nova.compute.claims [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Claim successful on node user
Oct 25 16:43:26 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:43:26 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:43:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:26 user nova-compute[74048]: INFO nova.network.neutron [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing instance network info cache due to event network-changed-5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] Acquiring lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:43:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Creating image(s)
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] Acquired lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.network.neutron [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Refreshing network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG nova.objects.base [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<32eb3254-db05-4a3f-a880-80f3757f0676> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "02a81e595e6ed8c85d5456b53912e1cb431845b5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "02a81e595e6ed8c85d5456b53912e1cb431845b5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG nova.virt.images [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] c9de2253-7fb7-420a-a904-e0b4282c1d31 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.part /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG nova.network.neutron [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updated VIF entry in instance network info cache for port 5b442979-bc1e-4ac2-93d5-530ecbb05ab9. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG nova.network.neutron [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9902193b-4346-4e42-b58f-d3f372b601a7 req-4a943cb3-2635-4dde-8bdb-20977058e5ec service nova] Releasing lock "refresh_cache-32eb3254-db05-4a3f-a880-80f3757f0676" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.part /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.converted" returned: 0 in 0.529s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "02a81e595e6ed8c85d5456b53912e1cb431845b5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.892s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "02a81e595e6ed8c85d5456b53912e1cb431845b5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "02a81e595e6ed8c85d5456b53912e1cb431845b5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 --force-share --output=json" returned: 0 in 0.218s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5,backing_fmt=raw /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5,backing_fmt=raw /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk 1073741824" returned: 0 in 0.051s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "02a81e595e6ed8c85d5456b53912e1cb431845b5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'migration_context' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG nova.objects.base [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<32eb3254-db05-4a3f-a880-80f3757f0676> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:43:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Rebasing disk image.
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 -F raw /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 -F raw /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk" returned: 0 in 2.163s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Ensure instance console log exists: /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Start _get_guest_xml network_info=[{"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e7621ba9c0c992f5fc4ca22652c59f54',container_format='bare',created_at=2023-10-25T16:41:33Z,direct_url=<?>,disk_format='qcow2',id=c9de2253-7fb7-420a-a904-e0b4282c1d31,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1804756607-shelved',owner='5dc9602800254bc4bf71768c629c59cf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T16:41:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:43:32 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:43:32 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e7621ba9c0c992f5fc4ca22652c59f54',container_format='bare',created_at=2023-10-25T16:41:33Z,direct_url=<?>,disk_format='qcow2',id=c9de2253-7fb7-420a-a904-e0b4282c1d31,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1804756607-shelved',owner='5dc9602800254bc4bf71768c629c59cf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T16:41:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.objects.base [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<32eb3254-db05-4a3f-a880-80f3757f0676> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804756607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804756607',id=29,image_ref='c9de2253-7fb7-420a-a904-e0b4282c1d31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-179865634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-j67ek4e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member',shelved_at='2023-10-25T16:41:37.097372',shelved_host='user',shelved_image_id='c9de2253-7fb7-420a-a904-e0b4282c1d31'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=32eb3254-db05-4a3f-a880-80f3757f0676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:43:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'pci_devices' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.objects.base [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Object Instance<32eb3254-db05-4a3f-a880-80f3757f0676> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:43:33 user nova-compute[74048]:   <uuid>32eb3254-db05-4a3f-a880-80f3757f0676</uuid>
Oct 25 16:43:33 user nova-compute[74048]:   <name>instance-0000001d</name>
Oct 25 16:43:33 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:43:33 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:43:33 user nova-compute[74048]:   <metadata>
Oct 25 16:43:33 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:43:33 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:43:33 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1804756607</nova:name>
Oct 25 16:43:33 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:43:32</nova:creationTime>
Oct 25 16:43:33 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:43:33 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:43:33 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:43:33 user nova-compute[74048]:       <nova:owner>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:user uuid="b8fb16c6fa0c4e3a8e8b05bd0222b4ba">tempest-AttachVolumeShelveTestJSON-1185084699-project-member</nova:user>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:project uuid="5dc9602800254bc4bf71768c629c59cf">tempest-AttachVolumeShelveTestJSON-1185084699</nova:project>
Oct 25 16:43:33 user nova-compute[74048]:       </nova:owner>
Oct 25 16:43:33 user nova-compute[74048]:       <nova:root type="image" uuid="c9de2253-7fb7-420a-a904-e0b4282c1d31"/>
Oct 25 16:43:33 user nova-compute[74048]:       <nova:ports>
Oct 25 16:43:33 user nova-compute[74048]:         <nova:port uuid="5b442979-bc1e-4ac2-93d5-530ecbb05ab9">
Oct 25 16:43:33 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:43:33 user nova-compute[74048]:         </nova:port>
Oct 25 16:43:33 user nova-compute[74048]:       </nova:ports>
Oct 25 16:43:33 user nova-compute[74048]:     </nova:instance>
Oct 25 16:43:33 user nova-compute[74048]:   </metadata>
Oct 25 16:43:33 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:43:33 user nova-compute[74048]:     <system>
Oct 25 16:43:33 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:43:33 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:43:33 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:43:33 user nova-compute[74048]:       <entry name="serial">32eb3254-db05-4a3f-a880-80f3757f0676</entry>
Oct 25 16:43:33 user nova-compute[74048]:       <entry name="uuid">32eb3254-db05-4a3f-a880-80f3757f0676</entry>
Oct 25 16:43:33 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:43:33 user nova-compute[74048]:     </system>
Oct 25 16:43:33 user nova-compute[74048]:   </sysinfo>
Oct 25 16:43:33 user nova-compute[74048]:   <os>
Oct 25 16:43:33 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:43:33 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:43:33 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:43:33 user nova-compute[74048]:   </os>
Oct 25 16:43:33 user nova-compute[74048]:   <features>
Oct 25 16:43:33 user nova-compute[74048]:     <acpi/>
Oct 25 16:43:33 user nova-compute[74048]:     <apic/>
Oct 25 16:43:33 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:43:33 user nova-compute[74048]:   </features>
Oct 25 16:43:33 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:43:33 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:43:33 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:43:33 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:43:33 user nova-compute[74048]:   </clock>
Oct 25 16:43:33 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:43:33 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:43:33 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:43:33 user nova-compute[74048]:   </cpu>
Oct 25 16:43:33 user nova-compute[74048]:   <devices>
Oct 25 16:43:33 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:43:33 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:43:33 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk"/>
Oct 25 16:43:33 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:43:33 user nova-compute[74048]:     </disk>
Oct 25 16:43:33 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:43:33 user nova-compute[74048]:       <mac address="fa:16:3e:f1:a6:63"/>
Oct 25 16:43:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:43:33 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:43:33 user nova-compute[74048]:       <target dev="tap5b442979-bc"/>
Oct 25 16:43:33 user nova-compute[74048]:     </interface>
Oct 25 16:43:33 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:43:33 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/console.log" append="off"/>
Oct 25 16:43:33 user nova-compute[74048]:     </serial>
Oct 25 16:43:33 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:43:33 user nova-compute[74048]:     <video>
Oct 25 16:43:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:43:33 user nova-compute[74048]:     </video>
Oct 25 16:43:33 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:43:33 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:43:33 user nova-compute[74048]:     </rng>
Oct 25 16:43:33 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:43:33 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:43:33 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:43:33 user nova-compute[74048]:     </memballoon>
Oct 25 16:43:33 user nova-compute[74048]:   </devices>
Oct 25 16:43:33 user nova-compute[74048]: </domain>
Oct 25 16:43:33 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804756607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804756607',id=29,image_ref='c9de2253-7fb7-420a-a904-e0b4282c1d31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-179865634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:39:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-j67ek4e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member',shelved_at='2023-10-25T16:41:37.097372',shelved_host='user',shelved_image_id='c9de2253-7fb7-420a-a904-e0b4282c1d31'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=32eb3254-db05-4a3f-a880-80f3757f0676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG os_vif [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28bfcfbf-5b23-5510-a83b-188494981bf0', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b442979-bc, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b442979-bc, col_values=(('qos', UUID('e66b278c-30b0-45a4-80bc-6e6e8b65ff22')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b442979-bc, col_values=(('external_ids', {'iface-id': '5b442979-bc1e-4ac2-93d5-530ecbb05ab9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:a6:63', 'vm-uuid': '32eb3254-db05-4a3f-a880-80f3757f0676'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:33 user nova-compute[74048]: INFO os_vif [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc')
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:43:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] No VIF found with MAC fa:16:3e:f1:a6:63, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:43:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-42d26836-e3ec-4f12-b990-29fe038e4092 req-ac7cf64a-b64c-4e5e-9136-34a8ed27729d service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-42d26836-e3ec-4f12-b990-29fe038e4092 req-ac7cf64a-b64c-4e5e-9136-34a8ed27729d service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-42d26836-e3ec-4f12-b990-29fe038e4092 req-ac7cf64a-b64c-4e5e-9136-34a8ed27729d service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-42d26836-e3ec-4f12-b990-29fe038e4092 req-ac7cf64a-b64c-4e5e-9136-34a8ed27729d service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-42d26836-e3ec-4f12-b990-29fe038e4092 req-ac7cf64a-b64c-4e5e-9136-34a8ed27729d service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:43:35 user nova-compute[74048]: WARNING nova.compute.manager [req-42d26836-e3ec-4f12-b990-29fe038e4092 req-ac7cf64a-b64c-4e5e-9136-34a8ed27729d service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 16:43:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:43:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:43:36 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance spawned successfully.
Oct 25 16:43:37 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:43:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-e273fdc3-f273-43b5-9769-1c23dc088599 req-e933ad52-95ce-4517-87f1-5e069ae2f5af service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:43:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e273fdc3-f273-43b5-9769-1c23dc088599 req-e933ad52-95ce-4517-87f1-5e069ae2f5af service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e273fdc3-f273-43b5-9769-1c23dc088599 req-e933ad52-95ce-4517-87f1-5e069ae2f5af service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e273fdc3-f273-43b5-9769-1c23dc088599 req-e933ad52-95ce-4517-87f1-5e069ae2f5af service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-e273fdc3-f273-43b5-9769-1c23dc088599 req-e933ad52-95ce-4517-87f1-5e069ae2f5af service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:43:37 user nova-compute[74048]: WARNING nova.compute.manager [req-e273fdc3-f273-43b5-9769-1c23dc088599 req-e933ad52-95ce-4517-87f1-5e069ae2f5af service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state active and task_state None.
Oct 25 16:43:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a0f797b5-38c0-47f3-982e-20f9027e7107 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.751s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:43:46 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-changed-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:43:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Refreshing instance network info cache due to event network-changed-f46f2238-e9dd-424d-9e20-915915c440ff. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:43:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] Acquiring lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:43:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] Acquired lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:43:47 user nova-compute[74048]: DEBUG nova.network.neutron [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Refreshing network info cache for port f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG nova.network.neutron [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updated VIF entry in instance network info cache for port f46f2238-e9dd-424d-9e20-915915c440ff. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG nova.network.neutron [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updating instance_info_cache with network_info: [{"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:43:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83482708-8285-42d4-b13b-75921a39edb2 req-cb2e7976-08a3-4d76-963f-d427c280365c service nova] Releasing lock "refresh_cache-7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:43:49 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG nova.objects.instance [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'flavor' on Instance uuid f0ef0c4d-5dc2-4593-842b-9afede760abb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:50 user nova-compute[74048]: INFO nova.compute.manager [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Attaching volume 1cf97490-d52a-4908-9350-baff9fff092a to /dev/vdb
Oct 25 16:43:50 user nova-compute[74048]: DEBUG os_brick.utils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db8f51-3bce-43f4-9c64-261fd5419ecb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b4aac-da4b-4764-aef1-f4e8aa7b4e9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20f57d6-2912-4247-bc87-ee7c835f85ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[59706536-59b2-4a31-92da-e83884857b08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:43:50 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf83c7e-fc67-45ee-acf5-675fb7eea9a2]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG os_brick.utils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating existing volume attachment record: 89d1e11b-1812-415d-b948-66e03a73bee6 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [{"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-4a970e43-ae6e-46fc-a5e7-173012590ca7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:43:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:43:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:43:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7818MB free_disk=25.045555114746094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f0ef0c4d-5dc2-4593-842b-9afede760abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 32eb3254-db05-4a3f-a880-80f3757f0676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:43:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:43:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:43:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:43:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:01 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:44:01 user nova-compute[74048]: INFO nova.compute.claims [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Claim successful on node user
Oct 25 16:44:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.576s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:44:02 user nova-compute[74048]: INFO nova.compute.claims [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Claim successful on node user
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.network.neutron [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:44:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:44:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Creating image(s)
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "/opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "/opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "/opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.policy [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df5f905d61744496bfafcdfd3f500896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd43437268443f5aa648d69dc0ad17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.237s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:44:02 user nova-compute[74048]: INFO nova.compute.claims [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Claim successful on node user
Oct 25 16:44:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.network.neutron [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.policy [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef034e25bba42e78a18c07c4e7ec3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2facb7bd1f4b47149df26f9494f180ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk 1073741824" returned: 0 in 0.084s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:03 user nova-compute[74048]: INFO nova.virt.block_device [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Booting with volume snapshot 3333b53c-c5aa-4ece-9ee2-715430a9b4fa at /dev/vda
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Successfully created port: 878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.395s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Cannot resize image /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Ensure instance console log exists: /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.101s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:44:04 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:44:04 user nova-compute[74048]: INFO nova.virt.block_device [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Booting with volume-backed-image 67778d28-28b7-4dc4-a7ab-187332587d81 at /dev/vda
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.policy [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a2170a4f3e541bea8147fbf3bc6b746', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4412dd65efab430eb361b71f048d3575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Successfully created port: e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Successfully updated port: 878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "refresh_cache-be2fbd73-d861-4dae-9c1e-082a596ef53d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquired lock "refresh_cache-be2fbd73-d861-4dae-9c1e-082a596ef53d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-changed-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Refreshing instance network info cache due to event network-changed-878034fa-7d7a-4145-8a0e-ec5551af0986. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] Acquiring lock "refresh_cache-be2fbd73-d861-4dae-9c1e-082a596ef53d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:44:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Updating instance_info_cache with network_info: [{"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Releasing lock "refresh_cache-be2fbd73-d861-4dae-9c1e-082a596ef53d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Instance network_info: |[{"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] Acquired lock "refresh_cache-be2fbd73-d861-4dae-9c1e-082a596ef53d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Refreshing network info cache for port 878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Start _get_guest_xml network_info=[{"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:44:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1368785710',display_name='tempest-ServersNegativeTestJSON-server-1368785710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1368785710',id=34,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd43437268443f5aa648d69dc0ad17c',ramdisk_id='',reservation_id='r-6m5adrjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069803193',owner_user_name='tempest-ServersNegativeTestJSON-2069803193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:02Z,user_data=None,user_id='df5f905d61744496bfafcdfd3f500896',uuid=be2fbd73-d861-4dae-9c1e-082a596ef53d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converting VIF {"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.objects.instance [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lazy-loading 'pci_devices' on Instance uuid be2fbd73-d861-4dae-9c1e-082a596ef53d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:44:05 user nova-compute[74048]:   <uuid>be2fbd73-d861-4dae-9c1e-082a596ef53d</uuid>
Oct 25 16:44:05 user nova-compute[74048]:   <name>instance-00000022</name>
Oct 25 16:44:05 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:44:05 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:44:05 user nova-compute[74048]:   <metadata>
Oct 25 16:44:05 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:44:05 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:44:05 user nova-compute[74048]:       <nova:name>tempest-ServersNegativeTestJSON-server-1368785710</nova:name>
Oct 25 16:44:05 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:44:05</nova:creationTime>
Oct 25 16:44:05 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:44:05 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:44:05 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:44:05 user nova-compute[74048]:       <nova:owner>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:user uuid="df5f905d61744496bfafcdfd3f500896">tempest-ServersNegativeTestJSON-2069803193-project-member</nova:user>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:project uuid="3dd43437268443f5aa648d69dc0ad17c">tempest-ServersNegativeTestJSON-2069803193</nova:project>
Oct 25 16:44:05 user nova-compute[74048]:       </nova:owner>
Oct 25 16:44:05 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:44:05 user nova-compute[74048]:       <nova:ports>
Oct 25 16:44:05 user nova-compute[74048]:         <nova:port uuid="878034fa-7d7a-4145-8a0e-ec5551af0986">
Oct 25 16:44:05 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 16:44:05 user nova-compute[74048]:         </nova:port>
Oct 25 16:44:05 user nova-compute[74048]:       </nova:ports>
Oct 25 16:44:05 user nova-compute[74048]:     </nova:instance>
Oct 25 16:44:05 user nova-compute[74048]:   </metadata>
Oct 25 16:44:05 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:44:05 user nova-compute[74048]:     <system>
Oct 25 16:44:05 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:44:05 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:44:05 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:44:05 user nova-compute[74048]:       <entry name="serial">be2fbd73-d861-4dae-9c1e-082a596ef53d</entry>
Oct 25 16:44:05 user nova-compute[74048]:       <entry name="uuid">be2fbd73-d861-4dae-9c1e-082a596ef53d</entry>
Oct 25 16:44:05 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:44:05 user nova-compute[74048]:     </system>
Oct 25 16:44:05 user nova-compute[74048]:   </sysinfo>
Oct 25 16:44:05 user nova-compute[74048]:   <os>
Oct 25 16:44:05 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:44:05 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:44:05 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:44:05 user nova-compute[74048]:   </os>
Oct 25 16:44:05 user nova-compute[74048]:   <features>
Oct 25 16:44:05 user nova-compute[74048]:     <acpi/>
Oct 25 16:44:05 user nova-compute[74048]:     <apic/>
Oct 25 16:44:05 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:44:05 user nova-compute[74048]:   </features>
Oct 25 16:44:05 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:44:05 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:44:05 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:44:05 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:44:05 user nova-compute[74048]:   </clock>
Oct 25 16:44:05 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:44:05 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:44:05 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:44:05 user nova-compute[74048]:   </cpu>
Oct 25 16:44:05 user nova-compute[74048]:   <devices>
Oct 25 16:44:05 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:44:05 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:44:05 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk"/>
Oct 25 16:44:05 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:44:05 user nova-compute[74048]:     </disk>
Oct 25 16:44:05 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:44:05 user nova-compute[74048]:       <mac address="fa:16:3e:fc:60:7f"/>
Oct 25 16:44:05 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:05 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:44:05 user nova-compute[74048]:       <target dev="tap878034fa-7d"/>
Oct 25 16:44:05 user nova-compute[74048]:     </interface>
Oct 25 16:44:05 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:44:05 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/console.log" append="off"/>
Oct 25 16:44:05 user nova-compute[74048]:     </serial>
Oct 25 16:44:05 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:44:05 user nova-compute[74048]:     <video>
Oct 25 16:44:05 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:05 user nova-compute[74048]:     </video>
Oct 25 16:44:05 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:44:05 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:44:05 user nova-compute[74048]:     </rng>
Oct 25 16:44:05 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:44:05 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:44:05 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:44:05 user nova-compute[74048]:     </memballoon>
Oct 25 16:44:05 user nova-compute[74048]:   </devices>
Oct 25 16:44:05 user nova-compute[74048]: </domain>
Oct 25 16:44:05 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1368785710',display_name='tempest-ServersNegativeTestJSON-server-1368785710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1368785710',id=34,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd43437268443f5aa648d69dc0ad17c',ramdisk_id='',reservation_id='r-6m5adrjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2069803193',owner_user_name='tempest-ServersNegativeTestJSON-2069803193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:02Z,user_data=None,user_id='df5f905d61744496bfafcdfd3f500896',uuid=be2fbd73-d861-4dae-9c1e-082a596ef53d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converting VIF {"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG os_vif [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77303091-7a6d-5bf3-9487-c2162e408d35', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap878034fa-7d, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap878034fa-7d, col_values=(('qos', UUID('16a20359-76f1-481e-a45d-e8ad7e9b4964')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap878034fa-7d, col_values=(('external_ids', {'iface-id': '878034fa-7d7a-4145-8a0e-ec5551af0986', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:60:7f', 'vm-uuid': 'be2fbd73-d861-4dae-9c1e-082a596ef53d'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:05 user nova-compute[74048]: INFO os_vif [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d')
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] No VIF found with MAC fa:16:3e:fc:60:7f, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Updated VIF entry in instance network info cache for port 878034fa-7d7a-4145-8a0e-ec5551af0986. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Updating instance_info_cache with network_info: [{"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-872ad6a0-c4d6-4663-900f-423c6b930fec req-57ee86e9-8fb7-4895-af3e-394d18cd3f73 service nova] Releasing lock "refresh_cache-be2fbd73-d861-4dae-9c1e-082a596ef53d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Successfully created port: a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:44:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Successfully updated port: e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquired lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-changed-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Refreshing instance network info cache due to event network-changed-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] Acquiring lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updating instance_info_cache with network_info: [{"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Releasing lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Instance network_info: |[{"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] Acquired lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.network.neutron [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Refreshing network info cache for port e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Successfully updated port: a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:44:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG nova.network.neutron [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updated VIF entry in instance network info cache for port e55d0c47-5c8f-4d26-b9c1-359f0aae35b5. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG nova.network.neutron [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updating instance_info_cache with network_info: [{"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updating instance_info_cache with network_info: [{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-70925240-95ee-488a-a982-cd1fbb7ea195 req-5e295fb3-ee0e-412a-8d11-b151b82afca7 service nova] Releasing lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance network_info: |[{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-changed-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Refreshing instance network info cache due to event network-changed-a7203e06-7480-4963-9eb3-469776bd8428. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Acquiring lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Acquired lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Refreshing network info cache for port a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updated VIF entry in instance network info cache for port a7203e06-7480-4963-9eb3-469776bd8428. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updating instance_info_cache with network_info: [{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Releasing lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] No waiting events found dispatching network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:08 user nova-compute[74048]: WARNING nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received unexpected event network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 for instance with vm_state building and task_state spawning.
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] No waiting events found dispatching network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:08 user nova-compute[74048]: WARNING nova.compute.manager [req-38b40ba6-7fd6-4e23-9938-90406730242d req-64d7cf45-1b48-46a6-89c1-bf93ab80e11d service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received unexpected event network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 for instance with vm_state building and task_state spawning.
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:44:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Instance spawned successfully.
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:09 user nova-compute[74048]: INFO nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Took 6.66 seconds to spawn the instance on the hypervisor.
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:44:09 user nova-compute[74048]: INFO nova.compute.manager [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Took 7.72 seconds to build instance.
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-562131de-dbcb-44b0-937a-b88be9e609c2 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.846s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG os_brick.utils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[150237cc-cbc4-4bdf-9858-8f7efcf08fe2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b2ea75-8cf0-46e3-884f-dcba53225487]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[57691adf-001f-4b61-9828-4498a1abad29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9839a532-1253-4871-b566-7b7e05a91444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:44:09 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:44:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f04b4-fa6e-48ae-b68b-e716e60dea9b]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG os_brick.utils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:44:09 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updating existing volume attachment record: fc193186-8f3a-4a49-83a3-d1f758be56c7 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljgRDEeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:44:10 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:10 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:10 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:44:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9739b3-769d-492d-bb43-da6b8765a097]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:44:10 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d85286-912e-4f07-aac0-8d0fd0de832d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a] added
Oct 25 16:44:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ead41-fe04-4f1c-bfc5-8da596465ea7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32de8f-a9ee-4a44-b1d4-ccb04ff44d4b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljgRDEeb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljgRDEeb" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffc9be-eaa4-4d53-bee3-1aaa946675c0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ljgRDEeb'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[714b78de-6ed1-4613-b6c7-5977a8a21a9f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b52e81-a2ee-4231-a421-2b24349a10e4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4877690-201f-4f07-a2cc-d7a60f9301ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260]
Oct 25 16:44:10 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260] successful.
Oct 25 16:44:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c9ef14-7d9f-4b31-bd20-09cfc35b933c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b609a-8f04-46c0-bd29-866364cdfd85]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:10 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:10 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ceae23-fc3c-4ab0-9b86-21dc2c748e97]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljgRDEeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:44:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26435313434633462', 'path': '/dev/sde'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:44:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435313434633462', 'path': '/dev/sde'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:44:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'flavor' on Instance uuid f0ef0c4d-5dc2-4593-842b-9afede760abb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:44:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:44:11 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:44:11 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:44:11 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:44:11 user nova-compute[74048]:   <serial>1cf97490-d52a-4908-9350-baff9fff092a</serial>
Oct 25 16:44:11 user nova-compute[74048]: </disk>
Oct 25 16:44:11 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:44:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:44:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:44:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] No VIF found with MAC fa:16:3e:10:13:cc, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:44:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-759583aa-4ab4-40c0-8818-f6a5bbb59da9 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.004s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-changed-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing instance network info cache due to event network-changed-8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:44:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:15 user nova-compute[74048]: DEBUG nova.network.neutron [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing network info cache for port 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:44:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updated VIF entry in instance network info cache for port 8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:44:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8eb539ed-7bbc-4c1e-95c9-510adfac4629 req-58d48943-a461-4302-9abb-2e88a9da17f7 service nova] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-changed-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing instance network info cache due to event network-changed-8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:44:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:18 user nova-compute[74048]: DEBUG nova.network.neutron [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing network info cache for port 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updated VIF entry in instance network info cache for port 8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:19 user nova-compute[74048]: INFO nova.compute.manager [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Rebooting instance
Oct 25 16:44:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a2f3650f-7350-4156-96e7-6142fe763126 req-015bb2f0-d92e-4a87-a228-47eb96112aa1 service nova] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-58ce130b-c484-4a5a-9acc-c81af2893c05 req-62ee47ef-b12a-4964-b54f-026245a2d54c service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-unplugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-58ce130b-c484-4a5a-9acc-c81af2893c05 req-62ee47ef-b12a-4964-b54f-026245a2d54c service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-58ce130b-c484-4a5a-9acc-c81af2893c05 req-62ee47ef-b12a-4964-b54f-026245a2d54c service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-58ce130b-c484-4a5a-9acc-c81af2893c05 req-62ee47ef-b12a-4964-b54f-026245a2d54c service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-58ce130b-c484-4a5a-9acc-c81af2893c05 req-62ee47ef-b12a-4964-b54f-026245a2d54c service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-unplugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:22 user nova-compute[74048]: WARNING nova.compute.manager [req-58ce130b-c484-4a5a-9acc-c81af2893c05 req-62ee47ef-b12a-4964-b54f-026245a2d54c service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-unplugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state active and task_state reboot_started.
Oct 25 16:44:23 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance shutdown successfully.
Oct 25 16:44:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-d00dd8a2-fd24-4c2c-95b1-c4a1d4edd5b0 req-4bd4e770-20c5-470d-b43e-167d6b81019e service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d00dd8a2-fd24-4c2c-95b1-c4a1d4edd5b0 req-4bd4e770-20c5-470d-b43e-167d6b81019e service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d00dd8a2-fd24-4c2c-95b1-c4a1d4edd5b0 req-4bd4e770-20c5-470d-b43e-167d6b81019e service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d00dd8a2-fd24-4c2c-95b1-c4a1d4edd5b0 req-4bd4e770-20c5-470d-b43e-167d6b81019e service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-d00dd8a2-fd24-4c2c-95b1-c4a1d4edd5b0 req-4bd4e770-20c5-470d-b43e-167d6b81019e service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:24 user nova-compute[74048]: WARNING nova.compute.manager [req-d00dd8a2-fd24-4c2c-95b1-c4a1d4edd5b0 req-4bd4e770-20c5-470d-b43e-167d6b81019e service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state active and task_state reboot_started.
Oct 25 16:44:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG os_brick.utils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409e815-fcf7-423e-9699-141966693a8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562d9a9-f6ca-4788-bed7-f4d57a96cd03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a3c05-5bce-4de4-987d-9502e503e5ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[543bf9ae-8930-448b-8b19-a7c5cd8dbe3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:44:25 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:44:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7f0dd-43e4-497e-8f10-e1a7d21c8974]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG os_brick.utils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updating existing volume attachment record: 087bc94a-d0ee-4c77-b3bc-e11fe8e7276d {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:44:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:26 user nova-compute[74048]: WARNING nova.compute.manager [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state active and task_state reboot_started.
Oct 25 16:44:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:26 user nova-compute[74048]: WARNING nova.compute.manager [req-efdc8d76-5af3-493c-b879-836dd608cf55 req-cf0a8539-3435-443b-98fd-4a70ae54876f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state active and task_state reboot_started.
Oct 25 16:44:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance running successfully.
Oct 25 16:44:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance soft rebooted successfully.
Oct 25 16:44:26 user nova-compute[74048]: DEBUG nova.compute.manager [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:44:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6e07d03d-0421-449b-ba91-f79612acf9e5 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.728s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:44:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Creating image(s)
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Ensure instance console log exists: /opt/stack/data/nova/instances/ab48c654-e08e-46aa-be56-3cb2b6d6552a/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Start _get_guest_xml network_info=[{"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T16:43:50Z,direct_url=<?>,disk_format='qcow2',id=3a6c0df4-30a6-4d5a-8bee-69c8edbbbeca,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2078862658',owner='2facb7bd1f4b47149df26f9494f180ae',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T16:43:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'fc193186-8f3a-4a49-83a3-d1f758be56c7', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVjhQFKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab48c654-e08e-46aa-be56-3cb2b6d6552a', 'attached_at': '', 'detached_at': '', 'volume_id': '3e583c3a-7cff-4503-a65e-b968a23d429b', 'serial': '3e583c3a-7cff-4503-a65e-b968a23d429b'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:44:29 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:29 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T16:43:50Z,direct_url=<?>,disk_format='qcow2',id=3a6c0df4-30a6-4d5a-8bee-69c8edbbbeca,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2078862658',owner='2facb7bd1f4b47149df26f9494f180ae',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T16:43:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVjhQFKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:44:29 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:29 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:29 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[33893c35-8efa-4afc-a68f-61701a214670]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:44:29 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd254da6-2f12-470d-9e3f-e7683569cb4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b] added
Oct 25 16:44:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cb6c17-b0a5-41b8-a460-63d759a9e2d0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[639b836d-d201-430e-b348-97d4882db435]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVjhQFKu {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVjhQFKu" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa28e6-fe59-4157-bb89-aa44aa74d71e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVjhQFKu'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b18c24-ae86-40e1-861a-cab36319f630]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9cae66-8590-4f48-ab0b-05ee6fd5c85b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2303b1-491a-4aaa-b4ff-7de0dbf2da17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260]
Oct 25 16:44:30 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260] successful.
Oct 25 16:44:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a6542-a346-4c7b-8644-bba12c07b5e6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae83480d-9d24-4f90-b64c-445602b89525]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:30 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2bb439-04c8-4cd8-a146-9166a6bbd2f3]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:44:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVjhQFKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23563333938636165', 'path': '/dev/sdf'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563333938636165', 'path': '/dev/sdf'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-901979718',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-901979718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-901979718',id=35,image_ref='3a6c0df4-30a6-4d5a-8bee-69c8edbbbeca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMUc11u+8WjUFIuvmMVcYUXsncugZDhZyEuWr1wjQPhuoXr4bXH+0dnSSTcM95rOqUTAj4yvjAHPszBBWgBUTv19/vDu9/SOUFtT3kLn9D1xGFEgOh0p8UcrKwMY+fwTg==',key_name='tempest-keypair-985729517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-t2zzdnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1454543820',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=ab48c654-e08e-46aa-be56-3cb2b6d6552a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.objects.instance [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'pci_devices' on Instance uuid ab48c654-e08e-46aa-be56-3cb2b6d6552a {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:44:31 user nova-compute[74048]:   <uuid>ab48c654-e08e-46aa-be56-3cb2b6d6552a</uuid>
Oct 25 16:44:31 user nova-compute[74048]:   <name>instance-00000023</name>
Oct 25 16:44:31 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:44:31 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:44:31 user nova-compute[74048]:   <metadata>
Oct 25 16:44:31 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:44:31 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:44:31 user nova-compute[74048]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-901979718</nova:name>
Oct 25 16:44:31 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:44:29</nova:creationTime>
Oct 25 16:44:31 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:44:31 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:44:31 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:44:31 user nova-compute[74048]:       <nova:owner>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:user uuid="0ef034e25bba42e78a18c07c4e7ec3b2">tempest-TestVolumeBootPattern-1454543820-project-member</nova:user>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:project uuid="2facb7bd1f4b47149df26f9494f180ae">tempest-TestVolumeBootPattern-1454543820</nova:project>
Oct 25 16:44:31 user nova-compute[74048]:       </nova:owner>
Oct 25 16:44:31 user nova-compute[74048]:       <nova:root type="image" uuid="3a6c0df4-30a6-4d5a-8bee-69c8edbbbeca"/>
Oct 25 16:44:31 user nova-compute[74048]:       <nova:ports>
Oct 25 16:44:31 user nova-compute[74048]:         <nova:port uuid="e55d0c47-5c8f-4d26-b9c1-359f0aae35b5">
Oct 25 16:44:31 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 16:44:31 user nova-compute[74048]:         </nova:port>
Oct 25 16:44:31 user nova-compute[74048]:       </nova:ports>
Oct 25 16:44:31 user nova-compute[74048]:     </nova:instance>
Oct 25 16:44:31 user nova-compute[74048]:   </metadata>
Oct 25 16:44:31 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:44:31 user nova-compute[74048]:     <system>
Oct 25 16:44:31 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:44:31 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:44:31 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:44:31 user nova-compute[74048]:       <entry name="serial">ab48c654-e08e-46aa-be56-3cb2b6d6552a</entry>
Oct 25 16:44:31 user nova-compute[74048]:       <entry name="uuid">ab48c654-e08e-46aa-be56-3cb2b6d6552a</entry>
Oct 25 16:44:31 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:44:31 user nova-compute[74048]:     </system>
Oct 25 16:44:31 user nova-compute[74048]:   </sysinfo>
Oct 25 16:44:31 user nova-compute[74048]:   <os>
Oct 25 16:44:31 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:44:31 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:44:31 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:44:31 user nova-compute[74048]:   </os>
Oct 25 16:44:31 user nova-compute[74048]:   <features>
Oct 25 16:44:31 user nova-compute[74048]:     <acpi/>
Oct 25 16:44:31 user nova-compute[74048]:     <apic/>
Oct 25 16:44:31 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:44:31 user nova-compute[74048]:   </features>
Oct 25 16:44:31 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:44:31 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:44:31 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:44:31 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:44:31 user nova-compute[74048]:   </clock>
Oct 25 16:44:31 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:44:31 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:44:31 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:44:31 user nova-compute[74048]:   </cpu>
Oct 25 16:44:31 user nova-compute[74048]:   <devices>
Oct 25 16:44:31 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:44:31 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:44:31 user nova-compute[74048]:       <source dev="/dev/sdf"/>
Oct 25 16:44:31 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:44:31 user nova-compute[74048]:       <serial>3e583c3a-7cff-4503-a65e-b968a23d429b</serial>
Oct 25 16:44:31 user nova-compute[74048]:     </disk>
Oct 25 16:44:31 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:44:31 user nova-compute[74048]:       <mac address="fa:16:3e:b8:b3:3f"/>
Oct 25 16:44:31 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:31 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:44:31 user nova-compute[74048]:       <target dev="tape55d0c47-5c"/>
Oct 25 16:44:31 user nova-compute[74048]:     </interface>
Oct 25 16:44:31 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:44:31 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/ab48c654-e08e-46aa-be56-3cb2b6d6552a/console.log" append="off"/>
Oct 25 16:44:31 user nova-compute[74048]:     </serial>
Oct 25 16:44:31 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:44:31 user nova-compute[74048]:     <video>
Oct 25 16:44:31 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:31 user nova-compute[74048]:     </video>
Oct 25 16:44:31 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:44:31 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:44:31 user nova-compute[74048]:     </rng>
Oct 25 16:44:31 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:44:31 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:44:31 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:44:31 user nova-compute[74048]:     </memballoon>
Oct 25 16:44:31 user nova-compute[74048]:   </devices>
Oct 25 16:44:31 user nova-compute[74048]: </domain>
Oct 25 16:44:31 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-901979718',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-901979718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-901979718',id=35,image_ref='3a6c0df4-30a6-4d5a-8bee-69c8edbbbeca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMUc11u+8WjUFIuvmMVcYUXsncugZDhZyEuWr1wjQPhuoXr4bXH+0dnSSTcM95rOqUTAj4yvjAHPszBBWgBUTv19/vDu9/SOUFtT3kLn9D1xGFEgOh0p8UcrKwMY+fwTg==',key_name='tempest-keypair-985729517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-t2zzdnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1454543820',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=ab48c654-e08e-46aa-be56-3cb2b6d6552a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG os_vif [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecf5be93-fcbf-564d-af1e-ac3c0f70374e', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape55d0c47-5c, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape55d0c47-5c, col_values=(('qos', UUID('033d2de0-1561-4c46-9382-ef68fc854726')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape55d0c47-5c, col_values=(('external_ids', {'iface-id': 'e55d0c47-5c8f-4d26-b9c1-359f0aae35b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:b3:3f', 'vm-uuid': 'ab48c654-e08e-46aa-be56-3cb2b6d6552a'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:31 user nova-compute[74048]: INFO os_vif [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c')
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:44:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No VIF found with MAC fa:16:3e:b8:b3:3f, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:44:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a6f2bcd-9ee9-4e74-811a-fbf5473906fd req-fed8ffd3-9b43-4af4-81f8-530cc26629b7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a6f2bcd-9ee9-4e74-811a-fbf5473906fd req-fed8ffd3-9b43-4af4-81f8-530cc26629b7 service nova] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a6f2bcd-9ee9-4e74-811a-fbf5473906fd req-fed8ffd3-9b43-4af4-81f8-530cc26629b7 service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a6f2bcd-9ee9-4e74-811a-fbf5473906fd req-fed8ffd3-9b43-4af4-81f8-530cc26629b7 service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a6f2bcd-9ee9-4e74-811a-fbf5473906fd req-fed8ffd3-9b43-4af4-81f8-530cc26629b7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] No waiting events found dispatching network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:33 user nova-compute[74048]: WARNING nova.compute.manager [req-7a6f2bcd-9ee9-4e74-811a-fbf5473906fd req-fed8ffd3-9b43-4af4-81f8-530cc26629b7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received unexpected event network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 for instance with vm_state building and task_state spawning.
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:44:35 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Instance spawned successfully.
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:35 user nova-compute[74048]: INFO nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:44:35 user nova-compute[74048]: INFO nova.compute.manager [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Took 33.80 seconds to build instance.
Oct 25 16:44:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dc285fcc-effa-4419-a832-bb07471348c2 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.929s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-aaca0cb3-e8fc-4a86-9709-dc8587a53960 req-87de7f98-43b8-4471-871e-f49f43cd35a3 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aaca0cb3-e8fc-4a86-9709-dc8587a53960 req-87de7f98-43b8-4471-871e-f49f43cd35a3 service nova] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aaca0cb3-e8fc-4a86-9709-dc8587a53960 req-87de7f98-43b8-4471-871e-f49f43cd35a3 service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aaca0cb3-e8fc-4a86-9709-dc8587a53960 req-87de7f98-43b8-4471-871e-f49f43cd35a3 service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-aaca0cb3-e8fc-4a86-9709-dc8587a53960 req-87de7f98-43b8-4471-871e-f49f43cd35a3 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] No waiting events found dispatching network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:35 user nova-compute[74048]: WARNING nova.compute.manager [req-aaca0cb3-e8fc-4a86-9709-dc8587a53960 req-87de7f98-43b8-4471-871e-f49f43cd35a3 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received unexpected event network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 for instance with vm_state active and task_state None.
Oct 25 16:44:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:43 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:44:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:46 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:48 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:44:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:44:48 user nova-compute[74048]: INFO nova.compute.claims [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Claim successful on node user
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:44:49 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.policy [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94d39f05315c44eb8f5bf10fdb424809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b185ea46741a3a68d7fbea88625f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:44:49 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Creating image(s)
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "/opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "/opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "/opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.225s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:49 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk 1073741824" returned: 0 in 0.062s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Successfully created port: 13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Cannot resize image /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Ensure instance console log exists: /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:50 user nova-compute[74048]: INFO nova.compute.manager [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Terminating instance
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Successfully updated port: 13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "refresh_cache-6561f6fa-7fbe-4cab-b818-083cb02d5acc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquired lock "refresh_cache-6561f6fa-7fbe-4cab-b818-083cb02d5acc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-b708392a-a03b-4bf8-bbe3-5104df03e554 req-04dd3cec-270e-410d-954b-68d670c6a0c3 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b708392a-a03b-4bf8-bbe3-5104df03e554 req-04dd3cec-270e-410d-954b-68d670c6a0c3 service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b708392a-a03b-4bf8-bbe3-5104df03e554 req-04dd3cec-270e-410d-954b-68d670c6a0c3 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b708392a-a03b-4bf8-bbe3-5104df03e554 req-04dd3cec-270e-410d-954b-68d670c6a0c3 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-b708392a-a03b-4bf8-bbe3-5104df03e554 req-04dd3cec-270e-410d-954b-68d670c6a0c3 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-b708392a-a03b-4bf8-bbe3-5104df03e554 req-04dd3cec-270e-410d-954b-68d670c6a0c3 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-unplugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Received event network-changed-13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Refreshing instance network info cache due to event network-changed-13c04bc6-6e02-479e-81e4-17a64533370f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] Acquiring lock "refresh_cache-6561f6fa-7fbe-4cab-b818-083cb02d5acc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:44:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Updating instance_info_cache with network_info: [{"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Releasing lock "refresh_cache-6561f6fa-7fbe-4cab-b818-083cb02d5acc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Instance network_info: |[{"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] Acquired lock "refresh_cache-6561f6fa-7fbe-4cab-b818-083cb02d5acc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.neutron [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Refreshing network info cache for port 13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Start _get_guest_xml network_info=[{"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:44:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Instance destroyed successfully.
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.objects.instance [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lazy-loading 'resources' on Instance uuid 7f739b1f-87a3-4521-bf08-c3b395fb0d44 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:44:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-191961762',display_name='tempest-ServerActionsTestOtherB-server-191961762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-191961762',id=26,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANxMiD7VfWCiKpXa7IFp7nbqzk6SkqED5kxAb0cZdGNf/Cd4YLUVHHrDoahAq2jm1doUinqJUE59cvptFKzJJaLJRCXle+MgWuHlWHHFkg9CcBHBUzLE3WD+UBtS+baKg==',key_name='tempest-keypair-789809144',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:42:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2991a6a83b4d420fae14308026933e56',ramdisk_id='',reservation_id='r-761hcr2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2012243518',owner_user_name='tempest-ServerActionsTestOtherB-2012243518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923326e5c82043a59dc710681f5b75d8',uuid=7f739b1f-87a3-4521-bf08-c3b395fb0d44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converting VIF {"id": "b225761b-69af-459c-ad4e-8901ba049969", "address": "fa:16:3e:c1:c0:a3", "network": {"id": "a0e3f212-48ca-476c-892f-2522fffa844e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-373174631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2991a6a83b4d420fae14308026933e56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb225761b-69", "ovs_interfaceid": "b225761b-69af-459c-ad4e-8901ba049969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_vif [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1811868830',display_name='tempest-VolumesActionsTest-instance-1811868830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1811868830',id=37,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f61b185ea46741a3a68d7fbea88625f4',ramdisk_id='',reservation_id='r-45mhkeki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1916941863',owner_user_name='tempest-VolumesActionsTest-1916941863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:49Z,user_data=None,user_id='94d39f05315c44eb8f5bf10fdb424809',uuid=6561f6fa-7fbe-4cab-b818-083cb02d5acc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converting VIF {"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.objects.instance [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lazy-loading 'pci_devices' on Instance uuid 6561f6fa-7fbe-4cab-b818-083cb02d5acc {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb225761b-69, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:44:51 user nova-compute[74048]:   <uuid>6561f6fa-7fbe-4cab-b818-083cb02d5acc</uuid>
Oct 25 16:44:51 user nova-compute[74048]:   <name>instance-00000025</name>
Oct 25 16:44:51 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:44:51 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:44:51 user nova-compute[74048]:   <metadata>
Oct 25 16:44:51 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:44:51 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:44:51 user nova-compute[74048]:       <nova:name>tempest-VolumesActionsTest-instance-1811868830</nova:name>
Oct 25 16:44:51 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:44:51</nova:creationTime>
Oct 25 16:44:51 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:44:51 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:44:51 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:44:51 user nova-compute[74048]:       <nova:owner>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:user uuid="94d39f05315c44eb8f5bf10fdb424809">tempest-VolumesActionsTest-1916941863-project-member</nova:user>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:project uuid="f61b185ea46741a3a68d7fbea88625f4">tempest-VolumesActionsTest-1916941863</nova:project>
Oct 25 16:44:51 user nova-compute[74048]:       </nova:owner>
Oct 25 16:44:51 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:44:51 user nova-compute[74048]:       <nova:ports>
Oct 25 16:44:51 user nova-compute[74048]:         <nova:port uuid="13c04bc6-6e02-479e-81e4-17a64533370f">
Oct 25 16:44:51 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 16:44:51 user nova-compute[74048]:         </nova:port>
Oct 25 16:44:51 user nova-compute[74048]:       </nova:ports>
Oct 25 16:44:51 user nova-compute[74048]:     </nova:instance>
Oct 25 16:44:51 user nova-compute[74048]:   </metadata>
Oct 25 16:44:51 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:44:51 user nova-compute[74048]:     <system>
Oct 25 16:44:51 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:44:51 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:44:51 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:44:51 user nova-compute[74048]:       <entry name="serial">6561f6fa-7fbe-4cab-b818-083cb02d5acc</entry>
Oct 25 16:44:51 user nova-compute[74048]:       <entry name="uuid">6561f6fa-7fbe-4cab-b818-083cb02d5acc</entry>
Oct 25 16:44:51 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:44:51 user nova-compute[74048]:     </system>
Oct 25 16:44:51 user nova-compute[74048]:   </sysinfo>
Oct 25 16:44:51 user nova-compute[74048]:   <os>
Oct 25 16:44:51 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:44:51 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:44:51 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:44:51 user nova-compute[74048]:   </os>
Oct 25 16:44:51 user nova-compute[74048]:   <features>
Oct 25 16:44:51 user nova-compute[74048]:     <acpi/>
Oct 25 16:44:51 user nova-compute[74048]:     <apic/>
Oct 25 16:44:51 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:44:51 user nova-compute[74048]:   </features>
Oct 25 16:44:51 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:44:51 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:44:51 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:44:51 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:44:51 user nova-compute[74048]:   </clock>
Oct 25 16:44:51 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:44:51 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:44:51 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:44:51 user nova-compute[74048]:   </cpu>
Oct 25 16:44:51 user nova-compute[74048]:   <devices>
Oct 25 16:44:51 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:44:51 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:44:51 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk"/>
Oct 25 16:44:51 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:44:51 user nova-compute[74048]:     </disk>
Oct 25 16:44:51 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:44:51 user nova-compute[74048]:       <mac address="fa:16:3e:12:48:fc"/>
Oct 25 16:44:51 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:51 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:44:51 user nova-compute[74048]:       <target dev="tap13c04bc6-6e"/>
Oct 25 16:44:51 user nova-compute[74048]:     </interface>
Oct 25 16:44:51 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:44:51 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/console.log" append="off"/>
Oct 25 16:44:51 user nova-compute[74048]:     </serial>
Oct 25 16:44:51 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:44:51 user nova-compute[74048]:     <video>
Oct 25 16:44:51 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:51 user nova-compute[74048]:     </video>
Oct 25 16:44:51 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:44:51 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:44:51 user nova-compute[74048]:     </rng>
Oct 25 16:44:51 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:44:51 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:44:51 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:44:51 user nova-compute[74048]:     </memballoon>
Oct 25 16:44:51 user nova-compute[74048]:   </devices>
Oct 25 16:44:51 user nova-compute[74048]: </domain>
Oct 25 16:44:51 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1811868830',display_name='tempest-VolumesActionsTest-instance-1811868830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1811868830',id=37,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f61b185ea46741a3a68d7fbea88625f4',ramdisk_id='',reservation_id='r-45mhkeki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1916941863',owner_user_name='tempest-VolumesActionsTest-1916941863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:49Z,user_data=None,user_id='94d39f05315c44eb8f5bf10fdb424809',uuid=6561f6fa-7fbe-4cab-b818-083cb02d5acc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converting VIF {"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_vif [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a317b543-1e41-4055-8272-b2cd1137cb12) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56760c43-e762-548c-9e23-1afc0a268353', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: INFO os_vif [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c0:a3,bridge_name='br-int',has_traffic_filtering=True,id=b225761b-69af-459c-ad4e-8901ba049969,network=Network(a0e3f212-48ca-476c-892f-2522fffa844e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb225761b-69')
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkdJBwOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:44:51 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c04bc6-6e, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13c04bc6-6e, col_values=(('qos', UUID('f8af1b29-1d46-4f1a-a127-1105904d018f')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13c04bc6-6e, col_values=(('external_ids', {'iface-id': '13c04bc6-6e02-479e-81e4-17a64533370f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:48:fc', 'vm-uuid': '6561f6fa-7fbe-4cab-b818-083cb02d5acc'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:51 user nova-compute[74048]: INFO os_vif [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e')
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c8ccc1-0939-4e3a-aa1a-71fe80b9d7df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:44:51 user nova-compute[74048]: No targets found.
Oct 25 16:44:51 user nova-compute[74048]: iSNS:
Oct 25 16:44:51 user nova-compute[74048]: No targets found.
Oct 25 16:44:51 user nova-compute[74048]: STATIC:
Oct 25 16:44:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1
Oct 25 16:44:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:44:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:44:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b
Oct 25 16:44:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:44:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:44:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a
Oct 25 16:44:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:44:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:44:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd
Oct 25 16:44:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:44:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:44:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:44:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:44:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:44:51 user nova-compute[74048]: FIRMWARE:
Oct 25 16:44:51 user nova-compute[74048]: No targets found.
Oct 25 16:44:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:44:51 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:44:51 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[49541771-4cdd-495b-b5a1-f63becb1735c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[447c898f-7222-411d-a99c-9ca4bf0cee91]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:51 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850374790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] No VIF found with MAC fa:16:3e:12:48:fc, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca8f1a-f965-4a2c-8e7b-ba1bc6e82eec]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b752d003-f6a3-40bf-96ad-5fd8004d7510]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68644f7-205b-4b70-8c97-43761a48c285]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9fc533-36df-4516-ab32-0921f2805aa9]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a0b3a-6b11-4770-93e2-1231baf5f1fb]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7daae16-3010-43ce-a018-a62cfc33b6af]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260]
Oct 25 16:44:51 user nova-compute[74048]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1, portal: 172.16.0.220,3260] successful.
Oct 25 16:44:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7ae9af-5c37-49be-8385-4ac04dc8c8e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ec32d-3a80-4d3e-9fc6-9b1ad1005bc9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] <== disconnect_volume: return (430ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:44:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:44:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Deleting instance files /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44_del
Oct 25 16:44:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Deletion of /opt/stack/data/nova/instances/7f739b1f-87a3-4521-bf08-c3b395fb0d44_del complete
Oct 25 16:44:52 user nova-compute[74048]: INFO nova.compute.manager [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Took 1.60 seconds to destroy the instance on the hypervisor.
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG nova.network.neutron [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Updated VIF entry in instance network info cache for port 13c04bc6-6e02-479e-81e4-17a64533370f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG nova.network.neutron [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Updating instance_info_cache with network_info: [{"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1afaf38f-74f1-49f1-bc05-e5c1fcc4cbb0 req-fb190757-d02a-45c7-9b7e-a1ae31bb2cd8 service nova] Releasing lock "refresh_cache-6561f6fa-7fbe-4cab-b818-083cb02d5acc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:44:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-b00ae819-9509-4749-917c-9fe4b8b7117c req-c7f2af6d-0e2e-4cb4-92b5-ab2a1e0c2bb6 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b00ae819-9509-4749-917c-9fe4b8b7117c req-c7f2af6d-0e2e-4cb4-92b5-ab2a1e0c2bb6 service nova] Acquiring lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b00ae819-9509-4749-917c-9fe4b8b7117c req-c7f2af6d-0e2e-4cb4-92b5-ab2a1e0c2bb6 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b00ae819-9509-4749-917c-9fe4b8b7117c req-c7f2af6d-0e2e-4cb4-92b5-ab2a1e0c2bb6 service nova] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-b00ae819-9509-4749-917c-9fe4b8b7117c req-c7f2af6d-0e2e-4cb4-92b5-ab2a1e0c2bb6 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] No waiting events found dispatching network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:53 user nova-compute[74048]: WARNING nova.compute.manager [req-b00ae819-9509-4749-917c-9fe4b8b7117c req-c7f2af6d-0e2e-4cb4-92b5-ab2a1e0c2bb6 service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received unexpected event network-vif-plugged-b225761b-69af-459c-ad4e-8901ba049969 for instance with vm_state active and task_state deleting.
Oct 25 16:44:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:53 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Took 1.10 seconds to deallocate network for instance.
Oct 25 16:44:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-f153e119-ed04-4478-840d-5a169008f257 req-1d202dca-5c2a-4891-a8cd-06b9bdf042fe service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Received event network-vif-deleted-b225761b-69af-459c-ad4e-8901ba049969 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:53 user nova-compute[74048]: INFO nova.compute.manager [req-f153e119-ed04-4478-840d-5a169008f257 req-1d202dca-5c2a-4891-a8cd-06b9bdf042fe service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Neutron deleted interface b225761b-69af-459c-ad4e-8901ba049969; detaching it from the instance and deleting it from the info cache
Oct 25 16:44:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-f153e119-ed04-4478-840d-5a169008f257 req-1d202dca-5c2a-4891-a8cd-06b9bdf042fe service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-f153e119-ed04-4478-840d-5a169008f257 req-1d202dca-5c2a-4891-a8cd-06b9bdf042fe service nova] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Detach interface failed, port_id=b225761b-69af-459c-ad4e-8901ba049969, reason: Instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:53 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '7f739b1f-87a3-4521-bf08-c3b395fb0d44' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '7f739b1f-87a3-4521-bf08-c3b395fb0d44' (instance-0000001a)
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:54 user nova-compute[74048]: INFO nova.compute.manager [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] [instance: 7f739b1f-87a3-4521-bf08-c3b395fb0d44] Took 1.02 seconds to detach 1 volumes for instance.
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:44:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Received event network-vif-plugged-13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] Acquiring lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] No waiting events found dispatching network-vif-plugged-13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:55 user nova-compute[74048]: WARNING nova.compute.manager [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Received unexpected event network-vif-plugged-13c04bc6-6e02-479e-81e4-17a64533370f for instance with vm_state building and task_state spawning.
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Received event network-vif-plugged-13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] Acquiring lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] No waiting events found dispatching network-vif-plugged-13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:44:55 user nova-compute[74048]: WARNING nova.compute.manager [req-60a0fd7f-9917-4ff4-987e-fa45590d743e req-942dd9ab-4d93-4d94-806e-6e4d3619188b service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Received unexpected event network-vif-plugged-13c04bc6-6e02-479e-81e4-17a64533370f for instance with vm_state building and task_state spawning.
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:44:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Instance spawned successfully.
Oct 25 16:44:55 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:55 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7554MB free_disk=25.00200653076172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:44:55 user nova-compute[74048]: INFO nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Took 6.29 seconds to spawn the instance on the hypervisor.
Oct 25 16:44:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.515s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.129s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:55 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Deleted allocations for instance 7f739b1f-87a3-4521-bf08-c3b395fb0d44
Oct 25 16:44:55 user nova-compute[74048]: INFO nova.compute.manager [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Took 7.22 seconds to build instance.
Oct 25 16:44:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f0ef0c4d-5dc2-4593-842b-9afede760abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 32eb3254-db05-4a3f-a880-80f3757f0676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance be2fbd73-d861-4dae-9c1e-082a596ef53d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ab48c654-e08e-46aa-be56-3cb2b6d6552a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d55ba2df-e10c-415f-9caa-3c07a859dfe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 6561f6fa-7fbe-4cab-b818-083cb02d5acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-fa2025dd-0cfb-4a5f-ac13-3aef6260b215 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.479s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-eae42d4c-a402-4b55-ac60-db8a294e34d0 tempest-ServerActionsTestOtherB-2012243518 tempest-ServerActionsTestOtherB-2012243518-project-member] Lock "7f739b1f-87a3-4521-bf08-c3b395fb0d44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.609s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:44:57 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Creating image(s)
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Ensure instance console log exists: /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Start _get_guest_xml network_info=[{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '087bc94a-d0ee-4c77-b3bc-e11fe8e7276d', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd55ba2df-e10c-415f-9caa-3c07a859dfe2', 'attached_at': '', 'detached_at': '', 'volume_id': '17574fb2-fc85-4925-9b7e-859d681b2d0b', 'serial': '17574fb2-fc85-4925-9b7e-859d681b2d0b'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:44:57 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:57 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:44:57 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:57 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:44:57 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd09a5-d8d4-48d5-b69c-18642d995fda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:44:57 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308d720-6823-4f8a-bcf2-0249294dd698]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b] added
Oct 25 16:44:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa755ea-c256-457c-a853-8407db11f0aa]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2135f9-9f51-474b-ae9c-d413cde8565c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEBqdvLD {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEBqdvLD" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[688074e2-fd21-4dbc-aa14-c1bfd1f53d83]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XEBqdvLD'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d564b0d8-6e72-454e-a520-e3da55a3a3ab]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5160e700-3c45-462d-a73e-2172e2b9c836]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[277f23ec-5267-4ece-899d-f8fb777f197d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260]
Oct 25 16:44:57 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260] successful.
Oct 25 16:44:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8fdb7d-df1a-4df6-9685-da00c8cfcb3d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20b9d6-ddde-448d-9eb5-6933caf549ac]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:44:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:44:57 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:44:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e05601-f3e1-4342-8321-8e33c815937e]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:44:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23033613630353637', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033613630353637', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-325270038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-325270038',id=36,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-tiff35np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:04Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d55ba2df-e10c-415f-9caa-3c07a859dfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'pci_devices' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:44:58 user nova-compute[74048]:   <uuid>d55ba2df-e10c-415f-9caa-3c07a859dfe2</uuid>
Oct 25 16:44:58 user nova-compute[74048]:   <name>instance-00000024</name>
Oct 25 16:44:58 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:44:58 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:44:58 user nova-compute[74048]:   <metadata>
Oct 25 16:44:58 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:44:58 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:44:58 user nova-compute[74048]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-325270038</nova:name>
Oct 25 16:44:58 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:44:57</nova:creationTime>
Oct 25 16:44:58 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:44:58 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:44:58 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:44:58 user nova-compute[74048]:       <nova:owner>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:user uuid="6a2170a4f3e541bea8147fbf3bc6b746">tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member</nova:user>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:project uuid="4412dd65efab430eb361b71f048d3575">tempest-ServerBootFromVolumeStableRescueTest-399579320</nova:project>
Oct 25 16:44:58 user nova-compute[74048]:       </nova:owner>
Oct 25 16:44:58 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:44:58 user nova-compute[74048]:       <nova:ports>
Oct 25 16:44:58 user nova-compute[74048]:         <nova:port uuid="a7203e06-7480-4963-9eb3-469776bd8428">
Oct 25 16:44:58 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:44:58 user nova-compute[74048]:         </nova:port>
Oct 25 16:44:58 user nova-compute[74048]:       </nova:ports>
Oct 25 16:44:58 user nova-compute[74048]:     </nova:instance>
Oct 25 16:44:58 user nova-compute[74048]:   </metadata>
Oct 25 16:44:58 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:44:58 user nova-compute[74048]:     <system>
Oct 25 16:44:58 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:44:58 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:44:58 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:44:58 user nova-compute[74048]:       <entry name="serial">d55ba2df-e10c-415f-9caa-3c07a859dfe2</entry>
Oct 25 16:44:58 user nova-compute[74048]:       <entry name="uuid">d55ba2df-e10c-415f-9caa-3c07a859dfe2</entry>
Oct 25 16:44:58 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:44:58 user nova-compute[74048]:     </system>
Oct 25 16:44:58 user nova-compute[74048]:   </sysinfo>
Oct 25 16:44:58 user nova-compute[74048]:   <os>
Oct 25 16:44:58 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:44:58 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:44:58 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:44:58 user nova-compute[74048]:   </os>
Oct 25 16:44:58 user nova-compute[74048]:   <features>
Oct 25 16:44:58 user nova-compute[74048]:     <acpi/>
Oct 25 16:44:58 user nova-compute[74048]:     <apic/>
Oct 25 16:44:58 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:44:58 user nova-compute[74048]:   </features>
Oct 25 16:44:58 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:44:58 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:44:58 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:44:58 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:44:58 user nova-compute[74048]:   </clock>
Oct 25 16:44:58 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:44:58 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:44:58 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:44:58 user nova-compute[74048]:   </cpu>
Oct 25 16:44:58 user nova-compute[74048]:   <devices>
Oct 25 16:44:58 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:44:58 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:44:58 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:44:58 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:44:58 user nova-compute[74048]:       <serial>17574fb2-fc85-4925-9b7e-859d681b2d0b</serial>
Oct 25 16:44:58 user nova-compute[74048]:     </disk>
Oct 25 16:44:58 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:44:58 user nova-compute[74048]:       <mac address="fa:16:3e:4b:04:eb"/>
Oct 25 16:44:58 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:58 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:44:58 user nova-compute[74048]:       <target dev="tapa7203e06-74"/>
Oct 25 16:44:58 user nova-compute[74048]:     </interface>
Oct 25 16:44:58 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:44:58 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/console.log" append="off"/>
Oct 25 16:44:58 user nova-compute[74048]:     </serial>
Oct 25 16:44:58 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:44:58 user nova-compute[74048]:     <video>
Oct 25 16:44:58 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:44:58 user nova-compute[74048]:     </video>
Oct 25 16:44:58 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:44:58 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:44:58 user nova-compute[74048]:     </rng>
Oct 25 16:44:58 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:44:58 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:44:58 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:44:58 user nova-compute[74048]:     </memballoon>
Oct 25 16:44:58 user nova-compute[74048]:   </devices>
Oct 25 16:44:58 user nova-compute[74048]: </domain>
Oct 25 16:44:58 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-325270038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-325270038',id=36,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-tiff35np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:44:04Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d55ba2df-e10c-415f-9caa-3c07a859dfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG os_vif [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73e32f40-a11a-5a31-8525-fcef5d947c14', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7203e06-74, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7203e06-74, col_values=(('qos', UUID('cc93650e-be22-4ab0-96f6-dca35de3c15e')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7203e06-74, col_values=(('external_ids', {'iface-id': 'a7203e06-7480-4963-9eb3-469776bd8428', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:04:eb', 'vm-uuid': 'd55ba2df-e10c-415f-9caa-3c07a859dfe2'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:44:58 user nova-compute[74048]: INFO os_vif [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74')
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:44:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No VIF found with MAC fa:16:3e:4b:04:eb, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-e13e0d2a-e82f-447a-8eea-a3c9caa95a98 req-dbf1aecd-822d-4e9a-b371-48f8d867fcc7 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e13e0d2a-e82f-447a-8eea-a3c9caa95a98 req-dbf1aecd-822d-4e9a-b371-48f8d867fcc7 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e13e0d2a-e82f-447a-8eea-a3c9caa95a98 req-dbf1aecd-822d-4e9a-b371-48f8d867fcc7 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e13e0d2a-e82f-447a-8eea-a3c9caa95a98 req-dbf1aecd-822d-4e9a-b371-48f8d867fcc7 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-e13e0d2a-e82f-447a-8eea-a3c9caa95a98 req-dbf1aecd-822d-4e9a-b371-48f8d867fcc7 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:00 user nova-compute[74048]: WARNING nova.compute.manager [req-e13e0d2a-e82f-447a-8eea-a3c9caa95a98 req-dbf1aecd-822d-4e9a-b371-48f8d867fcc7 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state building and task_state spawning.
Oct 25 16:45:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:45:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance spawned successfully.
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-c44a5e54-5f55-4943-8770-d08014197272 req-5912475c-66ec-4d3a-a295-d9fe13aeb74c service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c44a5e54-5f55-4943-8770-d08014197272 req-5912475c-66ec-4d3a-a295-d9fe13aeb74c service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c44a5e54-5f55-4943-8770-d08014197272 req-5912475c-66ec-4d3a-a295-d9fe13aeb74c service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c44a5e54-5f55-4943-8770-d08014197272 req-5912475c-66ec-4d3a-a295-d9fe13aeb74c service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-c44a5e54-5f55-4943-8770-d08014197272 req-5912475c-66ec-4d3a-a295-d9fe13aeb74c service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:02 user nova-compute[74048]: WARNING nova.compute.manager [req-c44a5e54-5f55-4943-8770-d08014197272 req-5912475c-66ec-4d3a-a295-d9fe13aeb74c service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state building and task_state spawning.
Oct 25 16:45:02 user nova-compute[74048]: INFO nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 25 16:45:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:45:02 user nova-compute[74048]: INFO nova.compute.manager [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Took 59.72 seconds to build instance.
Oct 25 16:45:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2555cba5-b99c-4e4a-b644-60acc45f8eeb tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 59.888s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:15 user nova-compute[74048]: INFO nova.compute.manager [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Terminating instance
Oct 25 16:45:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:45:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-043b97be-4322-462e-aa53-ff07a135c9fe req-fd259da7-daae-45ee-ac2a-33feeebdd6ad service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-unplugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-043b97be-4322-462e-aa53-ff07a135c9fe req-fd259da7-daae-45ee-ac2a-33feeebdd6ad service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-043b97be-4322-462e-aa53-ff07a135c9fe req-fd259da7-daae-45ee-ac2a-33feeebdd6ad service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-043b97be-4322-462e-aa53-ff07a135c9fe req-fd259da7-daae-45ee-ac2a-33feeebdd6ad service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-043b97be-4322-462e-aa53-ff07a135c9fe req-fd259da7-daae-45ee-ac2a-33feeebdd6ad service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-unplugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-043b97be-4322-462e-aa53-ff07a135c9fe req-fd259da7-daae-45ee-ac2a-33feeebdd6ad service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-unplugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:45:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Instance destroyed successfully.
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.objects.instance [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lazy-loading 'resources' on Instance uuid 32eb3254-db05-4a3f-a880-80f3757f0676 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804756607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804756607',id=29,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNbVnkdtNdNw8mJMazZxYiak8LlGr87f9Wl9L056mc/2DvMhhEQ79Hfh5KiTQ0ly8vgBLYp5ed6qLOGZgmPoB36An89liZ7jiiyCDPLLvgC5Of19DBrwWuaEINZGZRJGg==',key_name='tempest-keypair-179865634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dc9602800254bc4bf71768c629c59cf',ramdisk_id='',reservation_id='r-j67ek4e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1185084699',owner_user_name='tempest-AttachVolumeShelveTestJSON-1185084699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8fb16c6fa0c4e3a8e8b05bd0222b4ba',uuid=32eb3254-db05-4a3f-a880-80f3757f0676,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converting VIF {"id": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "address": "fa:16:3e:f1:a6:63", "network": {"id": "c68f02f9-9408-412d-b1a9-37e9ebc66678", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-180286792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dc9602800254bc4bf71768c629c59cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b442979-bc", "ovs_interfaceid": "5b442979-bc1e-4ac2-93d5-530ecbb05ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG os_vif [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b442979-bc, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e66b278c-30b0-45a4-80bc-6e6e8b65ff22) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:45:16 user nova-compute[74048]: INFO os_vif [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a6:63,bridge_name='br-int',has_traffic_filtering=True,id=5b442979-bc1e-4ac2-93d5-530ecbb05ab9,network=Network(c68f02f9-9408-412d-b1a9-37e9ebc66678),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b442979-bc')
Oct 25 16:45:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Deleting instance files /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676_del
Oct 25 16:45:16 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Deletion of /opt/stack/data/nova/instances/32eb3254-db05-4a3f-a880-80f3757f0676_del complete
Oct 25 16:45:16 user nova-compute[74048]: INFO nova.compute.manager [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 25 16:45:16 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:45:16 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:45:17 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Took 0.78 seconds to deallocate network for instance.
Oct 25 16:45:17 user nova-compute[74048]: DEBUG nova.compute.manager [req-bbd84edc-c65f-4c06-a05c-1a861b243be2 req-e47f43d0-252d-472b-9855-85cb865a3f54 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-deleted-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:45:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:17 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Deleted allocations for instance 32eb3254-db05-4a3f-a880-80f3757f0676
Oct 25 16:45:17 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-78ffe15c-7398-4feb-bc0d-0840cf3df262 tempest-AttachVolumeShelveTestJSON-1185084699 tempest-AttachVolumeShelveTestJSON-1185084699-project-member] Lock "32eb3254-db05-4a3f-a880-80f3757f0676" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-d75d0560-d66e-440e-9911-0e831f27969d req-5a36c94c-0303-4268-bc98-21fb1905fb40 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d75d0560-d66e-440e-9911-0e831f27969d req-5a36c94c-0303-4268-bc98-21fb1905fb40 service nova] Acquiring lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d75d0560-d66e-440e-9911-0e831f27969d req-5a36c94c-0303-4268-bc98-21fb1905fb40 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d75d0560-d66e-440e-9911-0e831f27969d req-5a36c94c-0303-4268-bc98-21fb1905fb40 service nova] Lock "32eb3254-db05-4a3f-a880-80f3757f0676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-d75d0560-d66e-440e-9911-0e831f27969d req-5a36c94c-0303-4268-bc98-21fb1905fb40 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] No waiting events found dispatching network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:18 user nova-compute[74048]: WARNING nova.compute.manager [req-d75d0560-d66e-440e-9911-0e831f27969d req-5a36c94c-0303-4268-bc98-21fb1905fb40 service nova] [instance: 32eb3254-db05-4a3f-a880-80f3757f0676] Received unexpected event network-vif-plugged-5b442979-bc1e-4ac2-93d5-530ecbb05ab9 for instance with vm_state deleted and task_state None.
Oct 25 16:45:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:45:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:45:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:45:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:45:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:44 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:44 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:45:45 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:46 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:45:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:45:48 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:48 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:51 user nova-compute[74048]: INFO nova.compute.manager [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Terminating instance
Oct 25 16:45:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a712d13-d239-4d5d-a36f-29fbf7502178 req-7da3022b-f789-422e-8864-de9270e702af service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-vif-unplugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a712d13-d239-4d5d-a36f-29fbf7502178 req-7da3022b-f789-422e-8864-de9270e702af service nova] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a712d13-d239-4d5d-a36f-29fbf7502178 req-7da3022b-f789-422e-8864-de9270e702af service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7a712d13-d239-4d5d-a36f-29fbf7502178 req-7da3022b-f789-422e-8864-de9270e702af service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a712d13-d239-4d5d-a36f-29fbf7502178 req-7da3022b-f789-422e-8864-de9270e702af service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] No waiting events found dispatching network-vif-unplugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-7a712d13-d239-4d5d-a36f-29fbf7502178 req-7da3022b-f789-422e-8864-de9270e702af service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-vif-unplugged-878034fa-7d7a-4145-8a0e-ec5551af0986 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Instance destroyed successfully.
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.objects.instance [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lazy-loading 'resources' on Instance uuid be2fbd73-d861-4dae-9c1e-082a596ef53d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1368785710',display_name='tempest-ServersNegativeTestJSON-server-1368785710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1368785710',id=34,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:44:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd43437268443f5aa648d69dc0ad17c',ramdisk_id='',reservation_id='r-6m5adrjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2069803193',owner_user_name='tempest-ServersNegativeTestJSON-2069803193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:44:09Z,user_data=None,user_id='df5f905d61744496bfafcdfd3f500896',uuid=be2fbd73-d861-4dae-9c1e-082a596ef53d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converting VIF {"id": "878034fa-7d7a-4145-8a0e-ec5551af0986", "address": "fa:16:3e:fc:60:7f", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap878034fa-7d", "ovs_interfaceid": "878034fa-7d7a-4145-8a0e-ec5551af0986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG os_vif [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap878034fa-7d, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16a20359-76f1-481e-a45d-e8ad7e9b4964) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:52 user nova-compute[74048]: INFO os_vif [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:60:7f,bridge_name='br-int',has_traffic_filtering=True,id=878034fa-7d7a-4145-8a0e-ec5551af0986,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap878034fa-7d')
Oct 25 16:45:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Deleting instance files /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d_del
Oct 25 16:45:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Deletion of /opt/stack/data/nova/instances/be2fbd73-d861-4dae-9c1e-082a596ef53d_del complete
Oct 25 16:45:52 user nova-compute[74048]: INFO nova.compute.manager [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-changed-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Refreshing instance network info cache due to event network-changed-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] Acquiring lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] Acquired lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Refreshing network info cache for port e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:45:53 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Took 1.12 seconds to deallocate network for instance.
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:53 user nova-compute[74048]: INFO nova.compute.manager [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Terminating instance
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updated VIF entry in instance network info cache for port e55d0c47-5c8f-4d26-b9c1-359f0aae35b5. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updating instance_info_cache with network_info: [{"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83e5da52-06d5-479e-96ee-2b6710765f15 req-2f902dce-250a-411f-9b61-02e733253c19 service nova] Releasing lock "refresh_cache-ab48c654-e08e-46aa-be56-3cb2b6d6552a" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] Acquiring lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] No waiting events found dispatching network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:54 user nova-compute[74048]: WARNING nova.compute.manager [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received unexpected event network-vif-plugged-878034fa-7d7a-4145-8a0e-ec5551af0986 for instance with vm_state deleted and task_state None.
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-4b42f4c7-931b-4e04-8ed9-c8c5480d16a4 req-3105cbba-d963-4a05-9c15-712af88b87f4 service nova] [instance: be2fbd73-d861-4dae-9c1e-082a596ef53d] Received event network-vif-deleted-878034fa-7d7a-4145-8a0e-ec5551af0986 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e549f9e-5f53-4470-9cdf-a463fbd60919 req-b2e5b715-cc81-44bf-bdcd-74694e38df1f service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-vif-unplugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e549f9e-5f53-4470-9cdf-a463fbd60919 req-b2e5b715-cc81-44bf-bdcd-74694e38df1f service nova] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e549f9e-5f53-4470-9cdf-a463fbd60919 req-b2e5b715-cc81-44bf-bdcd-74694e38df1f service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5e549f9e-5f53-4470-9cdf-a463fbd60919 req-b2e5b715-cc81-44bf-bdcd-74694e38df1f service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e549f9e-5f53-4470-9cdf-a463fbd60919 req-b2e5b715-cc81-44bf-bdcd-74694e38df1f service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] No waiting events found dispatching network-vif-unplugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-5e549f9e-5f53-4470-9cdf-a463fbd60919 req-b2e5b715-cc81-44bf-bdcd-74694e38df1f service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-vif-unplugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:45:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=25.01955795288086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:54 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Instance destroyed successfully.
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'resources' on Instance uuid ab48c654-e08e-46aa-be56-3cb2b6d6552a {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-901979718',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-901979718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-901979718',id=35,image_ref='3a6c0df4-30a6-4d5a-8bee-69c8edbbbeca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMUc11u+8WjUFIuvmMVcYUXsncugZDhZyEuWr1wjQPhuoXr4bXH+0dnSSTcM95rOqUTAj4yvjAHPszBBWgBUTv19/vDu9/SOUFtT3kLn9D1xGFEgOh0p8UcrKwMY+fwTg==',key_name='tempest-keypair-985729517',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-t2zzdnkw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1454543820',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=ab48c654-e08e-46aa-be56-3cb2b6d6552a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "address": "fa:16:3e:b8:b3:3f", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d0c47-5c", "ovs_interfaceid": "e55d0c47-5c8f-4d26-b9c1-359f0aae35b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_vif [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape55d0c47-5c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=033d2de0-1561-4c46-9382-ef68fc854726) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:45:54 user nova-compute[74048]: INFO os_vif [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e55d0c47-5c8f-4d26-b9c1-359f0aae35b5,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d0c47-5c')
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVjhQFKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:45:54 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c72f0-a0c9-487c-816c-50493bf751ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:45:54 user nova-compute[74048]: No targets found.
Oct 25 16:45:54 user nova-compute[74048]: iSNS:
Oct 25 16:45:54 user nova-compute[74048]: No targets found.
Oct 25 16:45:54 user nova-compute[74048]: STATIC:
Oct 25 16:45:54 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:45:54 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:45:54 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:45:54 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b
Oct 25 16:45:54 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:45:54 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:45:54 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a
Oct 25 16:45:54 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:45:54 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:45:54 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd
Oct 25 16:45:54 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:45:54 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:45:54 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:45:54 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:45:54 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:45:54 user nova-compute[74048]: FIRMWARE:
Oct 25 16:45:54 user nova-compute[74048]: No targets found.
Oct 25 16:45:54 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:45:54 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:45:54 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:45:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee037234-28df-484a-81ea-6518f6a91478]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.436s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.118s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[502cb54e-3871-4cb2-bd1d-c48573c112c7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:45:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b (non-flash)
Oct 25 16:45:55 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:45:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18580593f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b'): ({'sdf'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Removing single pathed devices sdf {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Deleted allocations for instance be2fbd73-d861-4dae-9c1e-082a596ef53d
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dab3f9-d662-4501-be0e-2c46f9c8c162]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34b1ef-41cc-43ef-a805-3f7c11f153d0]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flushing IO for device /dev/sdf {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1ac4c6-b1fb-4405-bb89-8f944856b1b6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-56826106-dd1e-4d07-b4ee-771daa8653f9 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "be2fbd73-d861-4dae-9c1e-082a596ef53d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.580s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2535fe0-0d69-44b2-b1de-3d1c22493270]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] SCSI volumes sdf have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f0ef0c4d-5dc2-4593-842b-9afede760abb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance ab48c654-e08e-46aa-be56-3cb2b6d6552a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d55ba2df-e10c-415f-9caa-3c07a859dfe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 6561f6fa-7fbe-4cab-b818-083cb02d5acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[99183e0d-3296-4691-aec5-e8d2d8e2fac2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68532ec-2b9f-47b8-99b3-915cc9719096]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260]
Oct 25 16:45:55 user nova-compute[74048]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b, portal: 172.16.0.220,3260] successful.
Oct 25 16:45:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e583c3a-7cff-4503-a65e-b968a23d429b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546213c-267f-49c2-a4eb-712ad8a208f2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== disconnect_volume: return (363ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:45:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Deleting instance files /opt/stack/data/nova/instances/ab48c654-e08e-46aa-be56-3cb2b6d6552a_del
Oct 25 16:45:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Deletion of /opt/stack/data/nova/instances/ab48c654-e08e-46aa-be56-3cb2b6d6552a_del complete
Oct 25 16:45:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:55 user nova-compute[74048]: INFO nova.compute.manager [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Took 1.61 seconds to destroy the instance on the hypervisor.
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:45:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:45:56 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:45:56 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Took 0.73 seconds to deallocate network for instance.
Oct 25 16:45:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-3b8d0b8e-c98c-483a-908e-84f10e740652 req-1d36f0ca-6e60-486d-8724-f65193abb5a8 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-vif-deleted-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-428488fd-30ef-4efd-87c0-49b2aecf1e14 req-3411a9e2-282d-402e-9b3d-be8f0b997de7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received event network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:45:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-428488fd-30ef-4efd-87c0-49b2aecf1e14 req-3411a9e2-282d-402e-9b3d-be8f0b997de7 service nova] Acquiring lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-428488fd-30ef-4efd-87c0-49b2aecf1e14 req-3411a9e2-282d-402e-9b3d-be8f0b997de7 service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-428488fd-30ef-4efd-87c0-49b2aecf1e14 req-3411a9e2-282d-402e-9b3d-be8f0b997de7 service nova] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-428488fd-30ef-4efd-87c0-49b2aecf1e14 req-3411a9e2-282d-402e-9b3d-be8f0b997de7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] No waiting events found dispatching network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:45:56 user nova-compute[74048]: WARNING nova.compute.manager [req-428488fd-30ef-4efd-87c0-49b2aecf1e14 req-3411a9e2-282d-402e-9b3d-be8f0b997de7 service nova] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Received unexpected event network-vif-plugged-e55d0c47-5c8f-4d26-b9c1-359f0aae35b5 for instance with vm_state active and task_state deleting.
Oct 25 16:45:56 user nova-compute[74048]: INFO nova.compute.manager [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Took 0.83 seconds to detach 1 volumes for instance.
Oct 25 16:45:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: ab48c654-e08e-46aa-be56-3cb2b6d6552a] Deleting volume: 3e583c3a-7cff-4503-a65e-b968a23d429b {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:57 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Deleted allocations for instance ab48c654-e08e-46aa-be56-3cb2b6d6552a
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:45:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b2d18e62-e047-4e44-920c-baaf7c03e5b1 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "ab48c654-e08e-46aa-be56-3cb2b6d6552a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.905s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:45:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:45:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:45:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:45:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:45:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-changed-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing instance network info cache due to event network-changed-8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing network info cache for port 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updated VIF entry in instance network info cache for port 8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c275f4d-5eeb-4470-b773-17b79afd07f9 req-f15fa0b3-3967-4538-9c96-c9e522c0a767 service nova] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:46:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:12 user nova-compute[74048]: INFO nova.compute.manager [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Detaching volume 1cf97490-d52a-4908-9350-baff9fff092a
Oct 25 16:46:12 user nova-compute[74048]: INFO nova.virt.block_device [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Attempting to driver detach volume 1cf97490-d52a-4908-9350-baff9fff092a from mountpoint /dev/vdb
Oct 25 16:46:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Attempting to detach device vdb from instance f0ef0c4d-5dc2-4593-842b-9afede760abb from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:46:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:46:12 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:46:12 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:46:12 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:46:12 user nova-compute[74048]:   <serial>1cf97490-d52a-4908-9350-baff9fff092a</serial>
Oct 25 16:46:12 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:46:12 user nova-compute[74048]: </disk>
Oct 25 16:46:12 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:46:12 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully detached device vdb from instance f0ef0c4d-5dc2-4593-842b-9afede760abb from the persistent domain config.
Oct 25 16:46:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0ef0c4d-5dc2-4593-842b-9afede760abb from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:46:12 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:46:12 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:46:12 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:46:12 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:46:12 user nova-compute[74048]:   <serial>1cf97490-d52a-4908-9350-baff9fff092a</serial>
Oct 25 16:46:12 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:46:12 user nova-compute[74048]: </disk>
Oct 25 16:46:12 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0ef0c4d-5dc2-4593-842b-9afede760abb {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-changed-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing instance network info cache due to event network-changed-8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] Acquiring lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] Acquired lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Refreshing network info cache for port 8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updated VIF entry in instance network info cache for port 8c326348-bc58-4853-a099-536039b55332. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG nova.network.neutron [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [{"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3d0b9ac8-b49e-41d3-80d5-9d21f5803263 req-83bfef10-a07c-4eb5-bc40-ffcd903dd835 service nova] Releasing lock "refresh_cache-f0ef0c4d-5dc2-4593-842b-9afede760abb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:46:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0ef0c4d-5dc2-4593-842b-9afede760abb is timed out.
Oct 25 16:46:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully detached device vdb from instance f0ef0c4d-5dc2-4593-842b-9afede760abb from the live domain config.
Oct 25 16:46:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljgRDEeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:46:33 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[117cd137-1f2d-4391-9bd8-2e08ce30cf4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:46:33 user nova-compute[74048]: No targets found.
Oct 25 16:46:33 user nova-compute[74048]: iSNS:
Oct 25 16:46:33 user nova-compute[74048]: No targets found.
Oct 25 16:46:33 user nova-compute[74048]: STATIC:
Oct 25 16:46:33 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:46:33 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:33 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:33 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a
Oct 25 16:46:33 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:33 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:33 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd
Oct 25 16:46:33 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:33 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:33 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:46:33 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:33 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:33 user nova-compute[74048]: FIRMWARE:
Oct 25 16:46:33 user nova-compute[74048]: No targets found.
Oct 25 16:46:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:46:33 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:46:33 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff742d21-cce4-4b0e-8ed1-b5ab20fe69eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df8aee8-c4e4-4731-886d-77d6b0f95998]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:46:33 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:46:33 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:46:33 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:46:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:46:33 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:46:33 user nova-compute[74048]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a (non-flash)
Oct 25 16:46:33 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:46:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18405c0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a'): ({'sde'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Removing single pathed devices sde {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[942f2fe8-da43-40a6-be51-0419d523ba5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5315639d-25e6-46c7-a253-4c87ea703fca]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Flushing IO for device /dev/sde {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1dc4c-4da3-43c4-8c91-fe9233d57e93]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce750b-f5cd-4ff4-a89c-987f9d64ae7f]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dbe524-23a2-4495-a84c-96e66e0628ab]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d0952-e69f-40cf-8f48-f8b0beab5376]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260]
Oct 25 16:46:33 user nova-compute[74048]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a, portal: 172.16.0.220,3260] successful.
Oct 25 16:46:33 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cf97490-d52a-4908-9350-baff9fff092a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80db858-402a-489f-b7c9-38f41b074b54]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] <== disconnect_volume: return (312ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:46:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:46:34 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'flavor' on Instance uuid f0ef0c4d-5dc2-4593-842b-9afede760abb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1dc020c0-c30e-4d7f-a7ed-6d12fcfcd2ff tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.825s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:39 user nova-compute[74048]: INFO nova.compute.manager [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Terminating instance
Oct 25 16:46:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Instance destroyed successfully.
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.objects.instance [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lazy-loading 'resources' on Instance uuid 6561f6fa-7fbe-4cab-b818-083cb02d5acc {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1811868830',display_name='tempest-VolumesActionsTest-instance-1811868830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1811868830',id=37,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f61b185ea46741a3a68d7fbea88625f4',ramdisk_id='',reservation_id='r-45mhkeki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1916941863',owner_user_name='tempest-VolumesActionsTest-1916941863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:44:56Z,user_data=None,user_id='94d39f05315c44eb8f5bf10fdb424809',uuid=6561f6fa-7fbe-4cab-b818-083cb02d5acc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converting VIF {"id": "13c04bc6-6e02-479e-81e4-17a64533370f", "address": "fa:16:3e:12:48:fc", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c04bc6-6e", "ovs_interfaceid": "13c04bc6-6e02-479e-81e4-17a64533370f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG os_vif [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c04bc6-6e, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8af1b29-1d46-4f1a-a127-1105904d018f) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:40 user nova-compute[74048]: INFO os_vif [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=13c04bc6-6e02-479e-81e4-17a64533370f,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c04bc6-6e')
Oct 25 16:46:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Deleting instance files /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc_del
Oct 25 16:46:40 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Deletion of /opt/stack/data/nova/instances/6561f6fa-7fbe-4cab-b818-083cb02d5acc_del complete
Oct 25 16:46:40 user nova-compute[74048]: INFO nova.compute.manager [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 25 16:46:40 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:46:40 user nova-compute[74048]: INFO nova.compute.claims [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Claim successful on node user
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:40 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Took 0.59 seconds to deallocate network for instance.
Oct 25 16:46:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.compute.manager [req-5f16a0b1-c0d1-4699-8f33-5a162db490e9 req-b8d4db42-1d8b-47c5-a8a5-ad0d4d93c457 service nova] [instance: 6561f6fa-7fbe-4cab-b818-083cb02d5acc] Received event network-vif-deleted-13c04bc6-6e02-479e-81e4-17a64533370f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:40 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.178s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:46:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.policy [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5010a1f24ffe411f849b0917ee40d17b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9cc47d22fc44f9babc2ec69f539e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:46:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Creating image(s)
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:41 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Deleted allocations for instance 6561f6fa-7fbe-4cab-b818-083cb02d5acc
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ba01f7be-5cbd-4556-a6f4-7d83287b561a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "6561f6fa-7fbe-4cab-b818-083cb02d5acc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.284s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk 1073741824" returned: 0 in 0.059s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Successfully created port: d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.263s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Cannot resize image /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Ensure instance console log exists: /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Successfully updated port: d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-changed-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Refreshing instance network info cache due to event network-changed-d3c8049b-bdc5-494f-aa5f-036fb3218564. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:46:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance network_info: |[{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Refreshing network info cache for port d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start _get_guest_xml network_info=[{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:46:43 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:46:43 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'pci_devices' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:46:43 user nova-compute[74048]:   <uuid>063fb985-6780-4196-90b6-dc92ab263244</uuid>
Oct 25 16:46:43 user nova-compute[74048]:   <name>instance-00000026</name>
Oct 25 16:46:43 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:46:43 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:46:43 user nova-compute[74048]:   <metadata>
Oct 25 16:46:43 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:46:43 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:46:43 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeTestJSON-server-789838502</nova:name>
Oct 25 16:46:43 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:46:43</nova:creationTime>
Oct 25 16:46:43 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:46:43 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:46:43 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:46:43 user nova-compute[74048]:       <nova:owner>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:user uuid="5010a1f24ffe411f849b0917ee40d17b">tempest-AttachVolumeTestJSON-251204741-project-member</nova:user>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:project uuid="4a9cc47d22fc44f9babc2ec69f539e77">tempest-AttachVolumeTestJSON-251204741</nova:project>
Oct 25 16:46:43 user nova-compute[74048]:       </nova:owner>
Oct 25 16:46:43 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:46:43 user nova-compute[74048]:       <nova:ports>
Oct 25 16:46:43 user nova-compute[74048]:         <nova:port uuid="d3c8049b-bdc5-494f-aa5f-036fb3218564">
Oct 25 16:46:43 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:46:43 user nova-compute[74048]:         </nova:port>
Oct 25 16:46:43 user nova-compute[74048]:       </nova:ports>
Oct 25 16:46:43 user nova-compute[74048]:     </nova:instance>
Oct 25 16:46:43 user nova-compute[74048]:   </metadata>
Oct 25 16:46:43 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:46:43 user nova-compute[74048]:     <system>
Oct 25 16:46:43 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:46:43 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:46:43 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:46:43 user nova-compute[74048]:       <entry name="serial">063fb985-6780-4196-90b6-dc92ab263244</entry>
Oct 25 16:46:43 user nova-compute[74048]:       <entry name="uuid">063fb985-6780-4196-90b6-dc92ab263244</entry>
Oct 25 16:46:43 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:46:43 user nova-compute[74048]:     </system>
Oct 25 16:46:43 user nova-compute[74048]:   </sysinfo>
Oct 25 16:46:43 user nova-compute[74048]:   <os>
Oct 25 16:46:43 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:46:43 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:46:43 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:46:43 user nova-compute[74048]:   </os>
Oct 25 16:46:43 user nova-compute[74048]:   <features>
Oct 25 16:46:43 user nova-compute[74048]:     <acpi/>
Oct 25 16:46:43 user nova-compute[74048]:     <apic/>
Oct 25 16:46:43 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:46:43 user nova-compute[74048]:   </features>
Oct 25 16:46:43 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:46:43 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:46:43 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:46:43 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:46:43 user nova-compute[74048]:   </clock>
Oct 25 16:46:43 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:46:43 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:46:43 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:46:43 user nova-compute[74048]:   </cpu>
Oct 25 16:46:43 user nova-compute[74048]:   <devices>
Oct 25 16:46:43 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:46:43 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:46:43 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk"/>
Oct 25 16:46:43 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:46:43 user nova-compute[74048]:     </disk>
Oct 25 16:46:43 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:46:43 user nova-compute[74048]:       <mac address="fa:16:3e:54:94:ad"/>
Oct 25 16:46:43 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:46:43 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:46:43 user nova-compute[74048]:       <target dev="tapd3c8049b-bd"/>
Oct 25 16:46:43 user nova-compute[74048]:     </interface>
Oct 25 16:46:43 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:46:43 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/console.log" append="off"/>
Oct 25 16:46:43 user nova-compute[74048]:     </serial>
Oct 25 16:46:43 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:46:43 user nova-compute[74048]:     <video>
Oct 25 16:46:43 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:46:43 user nova-compute[74048]:     </video>
Oct 25 16:46:43 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:46:43 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:46:43 user nova-compute[74048]:     </rng>
Oct 25 16:46:43 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:46:43 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:46:43 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:46:43 user nova-compute[74048]:     </memballoon>
Oct 25 16:46:43 user nova-compute[74048]:   </devices>
Oct 25 16:46:43 user nova-compute[74048]: </domain>
Oct 25 16:46:43 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG os_vif [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec594c7c-16f3-5ad1-beea-db9f60578006', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3c8049b-bd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3c8049b-bd, col_values=(('qos', UUID('29eb8831-b64b-4709-9d0e-db8176498725')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3c8049b-bd, col_values=(('external_ids', {'iface-id': 'd3c8049b-bdc5-494f-aa5f-036fb3218564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:94:ad', 'vm-uuid': '063fb985-6780-4196-90b6-dc92ab263244'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:43 user nova-compute[74048]: INFO os_vif [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd')
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No VIF found with MAC fa:16:3e:54:94:ad, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updated VIF entry in instance network info cache for port d3c8049b-bdc5-494f-aa5f-036fb3218564. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c69b9f4-23b5-45f1-bccb-7b68c638aa3e req-b96f25bc-bf33-412f-84f3-17d9c1a049ca service nova] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:46:43 user nova-compute[74048]: INFO nova.compute.manager [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Rescuing
Oct 25 16:46:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:46:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updating instance_info_cache with network_info: [{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-68dde1f8-ce1f-4aa3-930b-458cceb3d5db req-7192ac1d-fa2b-45d4-97db-fdcdc376d40a service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-68dde1f8-ce1f-4aa3-930b-458cceb3d5db req-7192ac1d-fa2b-45d4-97db-fdcdc376d40a service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-68dde1f8-ce1f-4aa3-930b-458cceb3d5db req-7192ac1d-fa2b-45d4-97db-fdcdc376d40a service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-68dde1f8-ce1f-4aa3-930b-458cceb3d5db req-7192ac1d-fa2b-45d4-97db-fdcdc376d40a service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-68dde1f8-ce1f-4aa3-930b-458cceb3d5db req-7192ac1d-fa2b-45d4-97db-fdcdc376d40a service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:44 user nova-compute[74048]: WARNING nova.compute.manager [req-68dde1f8-ce1f-4aa3-930b-458cceb3d5db req-7192ac1d-fa2b-45d4-97db-fdcdc376d40a service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state active and task_state rescuing.
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:45 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance destroyed successfully.
Oct 25 16:46:45 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Attempting a stable device rescue
Oct 25 16:46:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74048) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:46:45 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Creating image(s)
Oct 25 16:46:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "/opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "/opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG nova.objects.instance [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'trusted_certs' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "20e5358194e0f631d72c54261e4429488b492a94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "20e5358194e0f631d72c54261e4429488b492a94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:46 user nova-compute[74048]: WARNING nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state active and task_state rescuing.
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:46 user nova-compute[74048]: WARNING nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state building and task_state spawning.
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:46 user nova-compute[74048]: WARNING nova.compute.manager [req-370fc6ec-8435-4f46-9eb9-7453048290d7 req-f64be496-fd13-4bba-acf4-357ac06580dd service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state building and task_state spawning.
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.part --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.virt.images [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] 818539e3-50f5-4b3b-b6c5-6dab19d1d077 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.part /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.part /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.converted" returned: 0 in 0.793s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:46:47 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance spawned successfully.
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:47 user nova-compute[74048]: INFO nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Took 6.63 seconds to spawn the instance on the hypervisor.
Oct 25 16:46:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "20e5358194e0f631d72c54261e4429488b492a94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.505s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "20e5358194e0f631d72c54261e4429488b492a94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "20e5358194e0f631d72c54261e4429488b492a94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: INFO nova.compute.manager [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Took 7.69 seconds to build instance.
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94 --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94,backing_fmt=raw /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-0b22a722-ee2c-4886-ba99-12a467768011 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.848s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94,backing_fmt=raw /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue" returned: 0 in 0.056s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "20e5358194e0f631d72c54261e4429488b492a94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'migration_context' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<d55ba2df-e10c-415f-9caa-3c07a859dfe2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Start _get_guest_xml network_info=[{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "vif_mac": "fa:16:3e:4b:04:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '818539e3-50f5-4b3b-b6c5-6dab19d1d077', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '087bc94a-d0ee-4c77-b3bc-e11fe8e7276d', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd55ba2df-e10c-415f-9caa-3c07a859dfe2', 'attached_at': '', 'detached_at': '', 'volume_id': '17574fb2-fc85-4925-9b7e-859d681b2d0b', 'serial': '17574fb2-fc85-4925-9b7e-859d681b2d0b'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'resources' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<d55ba2df-e10c-415f-9caa-3c07a859dfe2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'numa_topology' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<d55ba2df-e10c-415f-9caa-3c07a859dfe2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:46:48 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:46:48 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'vcpu_model' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<d55ba2df-e10c-415f-9caa-3c07a859dfe2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:46:48 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:46:48 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:46:48 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b81f7b7-b683-4bde-a02e-55ec7bfc5b80]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XEBqdvLD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 16:46:48 user nova-compute[74048]: node.name = iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:46:48 user nova-compute[74048]: node.tpgt = -1
Oct 25 16:46:48 user nova-compute[74048]: node.startup = automatic
Oct 25 16:46:48 user nova-compute[74048]: node.leading_login = No
Oct 25 16:46:48 user nova-compute[74048]: iface.iscsi_ifacename = default
Oct 25 16:46:48 user nova-compute[74048]: iface.net_ifacename = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.ipaddress = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.prefix_len = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.hwaddress = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.transport_name = tcp
Oct 25 16:46:48 user nova-compute[74048]: iface.initiatorname = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.vlan_id = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.vlan_priority = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.vlan_state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.iface_num = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.mtu = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.port = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.bootproto = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.subnet_mask = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.gateway = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_alt_client_id = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_dns = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_learn_iqn = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_vendor_id_state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_vendor_id = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.dhcp_slp_da = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.fragmentation = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.gratuitous_arp = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.incoming_forwarding = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.tos_state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.tos = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.ttl = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.delayed_ack = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.tcp_nagle = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.tcp_wsf_state = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.tcp_wsf = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.tcp_timer_scale = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.tcp_timestamp = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.redirect = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.def_task_mgmt_timeout = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.header_digest = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.data_digest = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.immediate_data = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.initial_r2t = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.data_seq_inorder = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.data_pdu_inorder = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.erl = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.max_receive_data_len = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.first_burst_len = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.max_outstanding_r2t = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.max_burst_len = 0
Oct 25 16:46:48 user nova-compute[74048]: iface.chap_auth = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.bidi_chap = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.strict_login_compliance = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.discovery_auth = <empty>
Oct 25 16:46:48 user nova-compute[74048]: iface.discovery_logout = <empty>
Oct 25 16:46:48 user nova-compute[74048]: node.discovery_address = <empty>
Oct 25 16:46:48 user nova-compute[74048]: node.discovery_port = 0
Oct 25 16:46:48 user nova-compute[74048]: node.discovery_type = static
Oct 25 16:46:48 user nova-compute[74048]: node.session.initial_cmdsn = 0
Oct 25 16:46:48 user nova-compute[74048]: node.session.initial_login_retry_max = 8
Oct 25 16:46:48 user nova-compute[74048]: node.session.xmit_thread_priority = -20
Oct 25 16:46:48 user nova-compute[74048]: node.session.cmds_max = 128
Oct 25 16:46:48 user nova-compute[74048]: node.session.queue_depth = 32
Oct 25 16:46:48 user nova-compute[74048]: node.session.nr_sessions = 1
Oct 25 16:46:48 user nova-compute[74048]: node.session.auth.authmethod = CHAP
Oct 25 16:46:48 user nova-compute[74048]: node.session.auth.username = XEBqdvLD
Oct 25 16:46:48 user nova-compute[74048]: node.session.auth.password = ***
Oct 25 16:46:48 user nova-compute[74048]: node.session.auth.username_in = <empty>
Oct 25 16:46:48 user nova-compute[74048]: node.session.auth.password_in = <empty>
Oct 25 16:46:48 user nova-compute[74048]: node.session.auth.chap_algs = MD5
Oct 25 16:46:48 user nova-compute[74048]: node.session.timeo.replacement_timeout = 120
Oct 25 16:46:48 user nova-compute[74048]: node.session.err_timeo.abort_timeout = 15
Oct 25 16:46:48 user nova-compute[74048]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 16:46:48 user nova-compute[74048]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 16:46:48 user nova-compute[74048]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.FastAbort = Yes
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.InitialR2T = No
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.ImmediateData = Yes
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.MaxConnections = 1
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 16:46:48 user nova-compute[74048]: node.session.iscsi.ERL = 0
Oct 25 16:46:48 user nova-compute[74048]: node.session.scan = manual
Oct 25 16:46:48 user nova-compute[74048]: node.session.reopen_max = 0
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].address = 172.16.0.220
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].port = 3260
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].startup = manual
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].tcp.window_size = 524288
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].tcp.type_of_service = 0
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].timeo.logout_timeout = 15
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].timeo.login_timeout = 15
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].timeo.auth_timeout = 45
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].iscsi.DataDigest = None
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].iscsi.IFMarker = No
Oct 25 16:46:48 user nova-compute[74048]: node.conn[0].iscsi.OFMarker = No
Oct 25 16:46:48 user nova-compute[74048]: # END RECORD
Oct 25 16:46:48 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361e9a4-6399-4fe2-92ca-d1563b242715]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa51d9e-1fae-41eb-b361-be31fccef835]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEBqdvLD {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEBqdvLD" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdfa3a1-a691-43aa-8133-5c7127058a5d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XEBqdvLD'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7282412-40d5-4e3b-98fd-e020b278afd7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7525e63-9c87-4b23-8b11-18246b6d7335]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:46:48 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:46:48 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:46:48 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:46:48 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:46:48 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:46:48 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] HCTL ('34', '0', '0', 0) found on session 40 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc370560-5d13-427e-b025-8e4c07bc95b3]: (4, ('0 0 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Searching for a device in session 40 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23033613630353637', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033613630353637', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-325270038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-325270038',id=36,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-tiff35np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:45:03Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d55ba2df-e10c-415f-9caa-3c07a859dfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "vif_mac": "fa:16:3e:4b:04:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "vif_mac": "fa:16:3e:4b:04:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'pci_devices' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.objects.base [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Object Instance<d55ba2df-e10c-415f-9caa-3c07a859dfe2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:46:48 user nova-compute[74048]:   <uuid>d55ba2df-e10c-415f-9caa-3c07a859dfe2</uuid>
Oct 25 16:46:48 user nova-compute[74048]:   <name>instance-00000024</name>
Oct 25 16:46:48 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:46:48 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:46:48 user nova-compute[74048]:   <metadata>
Oct 25 16:46:48 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:46:48 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:46:48 user nova-compute[74048]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-325270038</nova:name>
Oct 25 16:46:48 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:46:48</nova:creationTime>
Oct 25 16:46:48 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:46:48 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:46:48 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:46:48 user nova-compute[74048]:       <nova:owner>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:user uuid="6a2170a4f3e541bea8147fbf3bc6b746">tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member</nova:user>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:project uuid="4412dd65efab430eb361b71f048d3575">tempest-ServerBootFromVolumeStableRescueTest-399579320</nova:project>
Oct 25 16:46:48 user nova-compute[74048]:       </nova:owner>
Oct 25 16:46:48 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:46:48 user nova-compute[74048]:       <nova:ports>
Oct 25 16:46:48 user nova-compute[74048]:         <nova:port uuid="a7203e06-7480-4963-9eb3-469776bd8428">
Oct 25 16:46:48 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 16:46:48 user nova-compute[74048]:         </nova:port>
Oct 25 16:46:48 user nova-compute[74048]:       </nova:ports>
Oct 25 16:46:48 user nova-compute[74048]:     </nova:instance>
Oct 25 16:46:48 user nova-compute[74048]:   </metadata>
Oct 25 16:46:48 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:46:48 user nova-compute[74048]:     <system>
Oct 25 16:46:48 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:46:48 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:46:48 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:46:48 user nova-compute[74048]:       <entry name="serial">d55ba2df-e10c-415f-9caa-3c07a859dfe2</entry>
Oct 25 16:46:48 user nova-compute[74048]:       <entry name="uuid">d55ba2df-e10c-415f-9caa-3c07a859dfe2</entry>
Oct 25 16:46:48 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:46:48 user nova-compute[74048]:     </system>
Oct 25 16:46:48 user nova-compute[74048]:   </sysinfo>
Oct 25 16:46:48 user nova-compute[74048]:   <os>
Oct 25 16:46:48 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:46:48 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:46:48 user nova-compute[74048]:   </os>
Oct 25 16:46:48 user nova-compute[74048]:   <features>
Oct 25 16:46:48 user nova-compute[74048]:     <acpi/>
Oct 25 16:46:48 user nova-compute[74048]:     <apic/>
Oct 25 16:46:48 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:46:48 user nova-compute[74048]:   </features>
Oct 25 16:46:48 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:46:48 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:46:48 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:46:48 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:46:48 user nova-compute[74048]:   </clock>
Oct 25 16:46:48 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:46:48 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:46:48 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:46:48 user nova-compute[74048]:   </cpu>
Oct 25 16:46:48 user nova-compute[74048]:   <devices>
Oct 25 16:46:48 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:46:48 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:46:48 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:46:48 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:46:48 user nova-compute[74048]:       <serial>17574fb2-fc85-4925-9b7e-859d681b2d0b</serial>
Oct 25 16:46:48 user nova-compute[74048]:     </disk>
Oct 25 16:46:48 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:46:48 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:46:48 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue"/>
Oct 25 16:46:48 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:46:48 user nova-compute[74048]:       <boot order="1"/>
Oct 25 16:46:48 user nova-compute[74048]:     </disk>
Oct 25 16:46:48 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:46:48 user nova-compute[74048]:       <mac address="fa:16:3e:4b:04:eb"/>
Oct 25 16:46:48 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:46:48 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:46:48 user nova-compute[74048]:       <target dev="tapa7203e06-74"/>
Oct 25 16:46:48 user nova-compute[74048]:     </interface>
Oct 25 16:46:48 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:46:48 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/console.log" append="off"/>
Oct 25 16:46:48 user nova-compute[74048]:     </serial>
Oct 25 16:46:48 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:46:48 user nova-compute[74048]:     <video>
Oct 25 16:46:48 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:46:48 user nova-compute[74048]:     </video>
Oct 25 16:46:48 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:46:48 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:46:48 user nova-compute[74048]:     </rng>
Oct 25 16:46:48 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:46:48 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:46:48 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:46:48 user nova-compute[74048]:     </memballoon>
Oct 25 16:46:48 user nova-compute[74048]:   </devices>
Oct 25 16:46:48 user nova-compute[74048]: </domain>
Oct 25 16:46:48 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:46:48 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance destroyed successfully.
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:46:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] No VIF found with MAC fa:16:3e:4b:04:eb, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:46:49 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:49 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-37558cfe-a554-4e55-bcbc-92d5fb5a8af4 req-d4b40cd6-2449-463f-812d-3f73e9c5ebf5 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-37558cfe-a554-4e55-bcbc-92d5fb5a8af4 req-d4b40cd6-2449-463f-812d-3f73e9c5ebf5 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-37558cfe-a554-4e55-bcbc-92d5fb5a8af4 req-d4b40cd6-2449-463f-812d-3f73e9c5ebf5 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-37558cfe-a554-4e55-bcbc-92d5fb5a8af4 req-d4b40cd6-2449-463f-812d-3f73e9c5ebf5 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-37558cfe-a554-4e55-bcbc-92d5fb5a8af4 req-d4b40cd6-2449-463f-812d-3f73e9c5ebf5 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:50 user nova-compute[74048]: WARNING nova.compute.manager [req-37558cfe-a554-4e55-bcbc-92d5fb5a8af4 req-d4b40cd6-2449-463f-812d-3f73e9c5ebf5 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state active and task_state rescuing.
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:50 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-2f6368fe-caf0-4658-b87f-a613dca42323 req-5fe176d0-db00-41bc-9bd0-e6264fec9c3d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2f6368fe-caf0-4658-b87f-a613dca42323 req-5fe176d0-db00-41bc-9bd0-e6264fec9c3d service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2f6368fe-caf0-4658-b87f-a613dca42323 req-5fe176d0-db00-41bc-9bd0-e6264fec9c3d service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2f6368fe-caf0-4658-b87f-a613dca42323 req-5fe176d0-db00-41bc-9bd0-e6264fec9c3d service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-2f6368fe-caf0-4658-b87f-a613dca42323 req-5fe176d0-db00-41bc-9bd0-e6264fec9c3d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:52 user nova-compute[74048]: WARNING nova.compute.manager [req-2f6368fe-caf0-4658-b87f-a613dca42323 req-5fe176d0-db00-41bc-9bd0-e6264fec9c3d service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state active and task_state rescuing.
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-bde31fe7-130f-416f-8b2a-00abce8a73f6 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:46:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:46:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=24.975704193115234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance f0ef0c4d-5dc2-4593-842b-9afede760abb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d55ba2df-e10c-415f-9caa-3c07a859dfe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:54 user nova-compute[74048]: INFO nova.compute.manager [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Terminating instance
Oct 25 16:46:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-a39f334d-b41e-4ae2-b2ce-000f61cb8a65 req-bd46457b-bc49-4e88-9eb2-37658cf188c1 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-vif-unplugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a39f334d-b41e-4ae2-b2ce-000f61cb8a65 req-bd46457b-bc49-4e88-9eb2-37658cf188c1 service nova] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a39f334d-b41e-4ae2-b2ce-000f61cb8a65 req-bd46457b-bc49-4e88-9eb2-37658cf188c1 service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a39f334d-b41e-4ae2-b2ce-000f61cb8a65 req-bd46457b-bc49-4e88-9eb2-37658cf188c1 service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-a39f334d-b41e-4ae2-b2ce-000f61cb8a65 req-bd46457b-bc49-4e88-9eb2-37658cf188c1 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] No waiting events found dispatching network-vif-unplugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-a39f334d-b41e-4ae2-b2ce-000f61cb8a65 req-bd46457b-bc49-4e88-9eb2-37658cf188c1 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-vif-unplugged-f46f2238-e9dd-424d-9e20-915915c440ff for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Instance destroyed successfully.
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.objects.instance [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'resources' on Instance uuid 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-24550678',display_name='tempest-TestVolumeBootPattern-volume-backed-server-24550678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-24550678',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJM9dWEBIUzYBGDn4kD9F/2CVgL9ro0W0qBxdijL9mUDSuMWLRJW/1lHqJlibYq1+kcAWYYFeWNcV/YlN5ZFOSIczOkI9Idw8cg9k0340lDeO5qakqRrPCcQbxhPl4utA==',key_name='tempest-keypair-951836702',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-4srjf7nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "f46f2238-e9dd-424d-9e20-915915c440ff", "address": "fa:16:3e:48:66:86", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46f2238-e9", "ovs_interfaceid": "f46f2238-e9dd-424d-9e20-915915c440ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_vif [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf46f2238-e9, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=237e3cee-99e5-47c1-a392-3f504c316a1f) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:46:55 user nova-compute[74048]: INFO os_vif [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:66:86,bridge_name='br-int',has_traffic_filtering=True,id=f46f2238-e9dd-424d-9e20-915915c440ff,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46f2238-e9')
Oct 25 16:46:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWcRBPSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:46:55 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf48c087-c52b-44bf-8c96-2da0bdbd1e5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:46:55 user nova-compute[74048]: No targets found.
Oct 25 16:46:55 user nova-compute[74048]: iSNS:
Oct 25 16:46:55 user nova-compute[74048]: No targets found.
Oct 25 16:46:55 user nova-compute[74048]: STATIC:
Oct 25 16:46:55 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:46:55 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:55 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:55 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd
Oct 25 16:46:55 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:55 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:55 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:46:55 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:46:55 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:46:55 user nova-compute[74048]: FIRMWARE:
Oct 25 16:46:55 user nova-compute[74048]: No targets found.
Oct 25 16:46:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:46:55 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:46:55 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f7f581-b66e-4fd4-bbd5-362209a30c34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.066s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a366519-c662-4920-ad80-bae782dd6136]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:46:55 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:46:55 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:46:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:46:55 user nova-compute[74048]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd (non-flash)
Oct 25 16:46:55 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:46:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185024f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31caa920-d6b4-41ad-9058-3ea6a9ca1186]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f7dd73-acc3-4471-8e1d-0f1cb19d547f]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d4dcc-0cd1-4fcb-842a-55b6fddc1fc3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.072s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24bd5d4-63a1-482b-b406-8febfc49ad51]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:46:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec009dd9-b63f-4359-8e99-97a315d71566]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9c8262-8940-42db-9d7c-0c292a541609]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260]
Oct 25 16:46:56 user nova-compute[74048]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd, portal: 172.16.0.220,3260] successful.
Oct 25 16:46:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ee842f5-d771-40cc-806a-f66a46b615dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc0c4ee-c8a5-4078-8ba7-72f69ab045db]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== disconnect_volume: return (380ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:46:56 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Deleting instance files /opt/stack/data/nova/instances/7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec_del
Oct 25 16:46:56 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Deletion of /opt/stack/data/nova/instances/7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec_del complete
Oct 25 16:46:56 user nova-compute[74048]: INFO nova.compute.manager [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 25 16:46:56 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:46:56 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:46:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-d507ee53-be69-4905-a94a-bad7c147113b req-4029df4d-d43b-4694-b4db-e841e8482626 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d507ee53-be69-4905-a94a-bad7c147113b req-4029df4d-d43b-4694-b4db-e841e8482626 service nova] Acquiring lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d507ee53-be69-4905-a94a-bad7c147113b req-4029df4d-d43b-4694-b4db-e841e8482626 service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d507ee53-be69-4905-a94a-bad7c147113b req-4029df4d-d43b-4694-b4db-e841e8482626 service nova] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-d507ee53-be69-4905-a94a-bad7c147113b req-4029df4d-d43b-4694-b4db-e841e8482626 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] No waiting events found dispatching network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:46:57 user nova-compute[74048]: WARNING nova.compute.manager [req-d507ee53-be69-4905-a94a-bad7c147113b req-4029df4d-d43b-4694-b4db-e841e8482626 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received unexpected event network-vif-plugged-f46f2238-e9dd-424d-9e20-915915c440ff for instance with vm_state active and task_state deleting.
Oct 25 16:46:57 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:57 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Took 1.12 seconds to deallocate network for instance.
Oct 25 16:46:58 user nova-compute[74048]: INFO nova.compute.manager [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Took 0.86 seconds to detach 1 volumes for instance.
Oct 25 16:46:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Deleting volume: 1ee842f5-d771-40cc-806a-f66a46b615dd {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 16:46:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:46:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:46:58 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:46:58 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:46:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:58 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Deleted allocations for instance 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec
Oct 25 16:46:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8d4c7275-5fa7-4820-a6ad-3d60c91c0460 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.899s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-ff8bcde1-81da-40f2-89a4-411be9787b1a req-c28edc03-89da-4797-82b2-26b81ea55ee2 service nova] [instance: 7bd06c7b-fa2a-45ee-a6cd-ed85a90e54ec] Received event network-vif-deleted-f46f2238-e9dd-424d-9e20-915915c440ff {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updating instance_info_cache with network_info: [{"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-d587e48c-2104-4f0b-a12c-7334a63d3d5f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:46:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:13 user nova-compute[74048]: INFO nova.compute.manager [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Terminating instance
Oct 25 16:47:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-74802a9f-085c-4351-9ccb-900bea1e5abb req-1e2e718a-234e-4f49-bc62-604bbb5cd278 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-unplugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-74802a9f-085c-4351-9ccb-900bea1e5abb req-1e2e718a-234e-4f49-bc62-604bbb5cd278 service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-74802a9f-085c-4351-9ccb-900bea1e5abb req-1e2e718a-234e-4f49-bc62-604bbb5cd278 service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-74802a9f-085c-4351-9ccb-900bea1e5abb req-1e2e718a-234e-4f49-bc62-604bbb5cd278 service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-74802a9f-085c-4351-9ccb-900bea1e5abb req-1e2e718a-234e-4f49-bc62-604bbb5cd278 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-unplugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:47:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-74802a9f-085c-4351-9ccb-900bea1e5abb req-1e2e718a-234e-4f49-bc62-604bbb5cd278 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-unplugged-8c326348-bc58-4853-a099-536039b55332 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Instance destroyed successfully.
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.objects.instance [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lazy-loading 'resources' on Instance uuid f0ef0c4d-5dc2-4593-842b-9afede760abb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1867684160',display_name='tempest-TestMinimumBasicScenario-server-1867684160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1867684160',id=31,image_ref='a18f5d33-9f78-4c9f-98b4-85ea5b650809',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe/rYMBSVCOewy3/RO1KXnxfgAa17smF44zhr27738pZPBhBcMsFbfgrLYmxkqEJHYsNI1a8IIm4KEBa+lQR4EYvONtycs87TDIdYhN/t2KzPmqmObVEPDzUtRigunDVg==',key_name='tempest-TestMinimumBasicScenario-1178096365',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='242b649ca85c446d84b89b770c703c47',ramdisk_id='',reservation_id='r-0h716837',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a18f5d33-9f78-4c9f-98b4-85ea5b650809',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-323418568',owner_user_name='tempest-TestMinimumBasicScenario-323418568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:44:27Z,user_data=None,user_id='50155e9b8e7d472882d4fcd6d84acfd1',uuid=f0ef0c4d-5dc2-4593-842b-9afede760abb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converting VIF {"id": "8c326348-bc58-4853-a099-536039b55332", "address": "fa:16:3e:10:13:cc", "network": {"id": "de8f2588-2523-4f41-ba82-0521c74949fc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-431759393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "242b649ca85c446d84b89b770c703c47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c326348-bc", "ovs_interfaceid": "8c326348-bc58-4853-a099-536039b55332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG os_vif [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c326348-bc, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2888fb6-3772-4c60-affb-64dea5698387) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:14 user nova-compute[74048]: INFO os_vif [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=8c326348-bc58-4853-a099-536039b55332,network=Network(de8f2588-2523-4f41-ba82-0521c74949fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c326348-bc')
Oct 25 16:47:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Deleting instance files /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb_del
Oct 25 16:47:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Deletion of /opt/stack/data/nova/instances/f0ef0c4d-5dc2-4593-842b-9afede760abb_del complete
Oct 25 16:47:14 user nova-compute[74048]: INFO nova.compute.manager [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 25 16:47:14 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:47:14 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Took 0.39 seconds to deallocate network for instance.
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-336c7f2c-d05e-47f4-b8cb-81bf6d13f344 req-0f745062-2c8b-42b8-b604-c2fd7cb8a51f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-deleted-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:47:14 user nova-compute[74048]: INFO nova.compute.manager [req-336c7f2c-d05e-47f4-b8cb-81bf6d13f344 req-0f745062-2c8b-42b8-b604-c2fd7cb8a51f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Neutron deleted interface 8c326348-bc58-4853-a099-536039b55332; detaching it from the instance and deleting it from the info cache
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.network.neutron [req-336c7f2c-d05e-47f4-b8cb-81bf6d13f344 req-0f745062-2c8b-42b8-b604-c2fd7cb8a51f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG nova.compute.manager [req-336c7f2c-d05e-47f4-b8cb-81bf6d13f344 req-0f745062-2c8b-42b8-b604-c2fd7cb8a51f service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Detach interface failed, port_id=8c326348-bc58-4853-a099-536039b55332, reason: Instance f0ef0c4d-5dc2-4593-842b-9afede760abb could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:15 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Deleted allocations for instance f0ef0c4d-5dc2-4593-842b-9afede760abb
Oct 25 16:47:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-abff3ffa-faff-4ce0-b559-5ebde3e70676 tempest-TestMinimumBasicScenario-323418568 tempest-TestMinimumBasicScenario-323418568-project-member] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.678s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-b2a63809-ef5b-4517-853a-07fc007a49a0 req-eafc4b42-2e6c-4fa4-8c45-e544f758e970 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b2a63809-ef5b-4517-853a-07fc007a49a0 req-eafc4b42-2e6c-4fa4-8c45-e544f758e970 service nova] Acquiring lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b2a63809-ef5b-4517-853a-07fc007a49a0 req-eafc4b42-2e6c-4fa4-8c45-e544f758e970 service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b2a63809-ef5b-4517-853a-07fc007a49a0 req-eafc4b42-2e6c-4fa4-8c45-e544f758e970 service nova] Lock "f0ef0c4d-5dc2-4593-842b-9afede760abb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-b2a63809-ef5b-4517-853a-07fc007a49a0 req-eafc4b42-2e6c-4fa4-8c45-e544f758e970 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] No waiting events found dispatching network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:47:15 user nova-compute[74048]: WARNING nova.compute.manager [req-b2a63809-ef5b-4517-853a-07fc007a49a0 req-eafc4b42-2e6c-4fa4-8c45-e544f758e970 service nova] [instance: f0ef0c4d-5dc2-4593-842b-9afede760abb] Received unexpected event network-vif-plugged-8c326348-bc58-4853-a099-536039b55332 for instance with vm_state deleted and task_state None.
Oct 25 16:47:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:30 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:47:31 user nova-compute[74048]: INFO nova.compute.claims [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Claim successful on node user
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.network.neutron [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:47:31 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.policy [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94d39f05315c44eb8f5bf10fdb424809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b185ea46741a3a68d7fbea88625f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:47:31 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Creating image(s)
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "/opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "/opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:31 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk 1073741824" returned: 0 in 0.059s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Successfully created port: 5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Cannot resize image /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Ensure instance console log exists: /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Successfully updated port: 5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "refresh_cache-1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquired lock "refresh_cache-1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-changed-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Refreshing instance network info cache due to event network-changed-5dae4018-03f9-4662-a656-82a3d121fd67. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] Acquiring lock "refresh_cache-1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:47:32 user nova-compute[74048]: DEBUG nova.network.neutron [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.neutron [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Updating instance_info_cache with network_info: [{"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Releasing lock "refresh_cache-1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Instance network_info: |[{"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] Acquired lock "refresh_cache-1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Refreshing network info cache for port 5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Start _get_guest_xml network_info=[{"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:47:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:47:33 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1928034511',display_name='tempest-VolumesActionsTest-instance-1928034511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1928034511',id=39,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f61b185ea46741a3a68d7fbea88625f4',ramdisk_id='',reservation_id='r-5ka79uom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1916941863',owner_user_name='tempest-VolumesActionsTest-1916941863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:47:32Z,user_data=None,user_id='94d39f05315c44eb8f5bf10fdb424809',uuid=1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converting VIF {"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:47:33 user nova-compute[74048]:   <uuid>1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd</uuid>
Oct 25 16:47:33 user nova-compute[74048]:   <name>instance-00000027</name>
Oct 25 16:47:33 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:47:33 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:47:33 user nova-compute[74048]:   <metadata>
Oct 25 16:47:33 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:47:33 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:47:33 user nova-compute[74048]:       <nova:name>tempest-VolumesActionsTest-instance-1928034511</nova:name>
Oct 25 16:47:33 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:47:33</nova:creationTime>
Oct 25 16:47:33 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:47:33 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:47:33 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:47:33 user nova-compute[74048]:       <nova:owner>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:user uuid="94d39f05315c44eb8f5bf10fdb424809">tempest-VolumesActionsTest-1916941863-project-member</nova:user>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:project uuid="f61b185ea46741a3a68d7fbea88625f4">tempest-VolumesActionsTest-1916941863</nova:project>
Oct 25 16:47:33 user nova-compute[74048]:       </nova:owner>
Oct 25 16:47:33 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:47:33 user nova-compute[74048]:       <nova:ports>
Oct 25 16:47:33 user nova-compute[74048]:         <nova:port uuid="5dae4018-03f9-4662-a656-82a3d121fd67">
Oct 25 16:47:33 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 16:47:33 user nova-compute[74048]:         </nova:port>
Oct 25 16:47:33 user nova-compute[74048]:       </nova:ports>
Oct 25 16:47:33 user nova-compute[74048]:     </nova:instance>
Oct 25 16:47:33 user nova-compute[74048]:   </metadata>
Oct 25 16:47:33 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:47:33 user nova-compute[74048]:     <system>
Oct 25 16:47:33 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:47:33 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:47:33 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:47:33 user nova-compute[74048]:       <entry name="serial">1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd</entry>
Oct 25 16:47:33 user nova-compute[74048]:       <entry name="uuid">1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd</entry>
Oct 25 16:47:33 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:47:33 user nova-compute[74048]:     </system>
Oct 25 16:47:33 user nova-compute[74048]:   </sysinfo>
Oct 25 16:47:33 user nova-compute[74048]:   <os>
Oct 25 16:47:33 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:47:33 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:47:33 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:47:33 user nova-compute[74048]:   </os>
Oct 25 16:47:33 user nova-compute[74048]:   <features>
Oct 25 16:47:33 user nova-compute[74048]:     <acpi/>
Oct 25 16:47:33 user nova-compute[74048]:     <apic/>
Oct 25 16:47:33 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:47:33 user nova-compute[74048]:   </features>
Oct 25 16:47:33 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:47:33 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:47:33 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:47:33 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:47:33 user nova-compute[74048]:   </clock>
Oct 25 16:47:33 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:47:33 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:47:33 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:47:33 user nova-compute[74048]:   </cpu>
Oct 25 16:47:33 user nova-compute[74048]:   <devices>
Oct 25 16:47:33 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:47:33 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:47:33 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk"/>
Oct 25 16:47:33 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:47:33 user nova-compute[74048]:     </disk>
Oct 25 16:47:33 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:47:33 user nova-compute[74048]:       <mac address="fa:16:3e:58:31:cf"/>
Oct 25 16:47:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:47:33 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:47:33 user nova-compute[74048]:       <target dev="tap5dae4018-03"/>
Oct 25 16:47:33 user nova-compute[74048]:     </interface>
Oct 25 16:47:33 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:47:33 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/console.log" append="off"/>
Oct 25 16:47:33 user nova-compute[74048]:     </serial>
Oct 25 16:47:33 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:47:33 user nova-compute[74048]:     <video>
Oct 25 16:47:33 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:47:33 user nova-compute[74048]:     </video>
Oct 25 16:47:33 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:47:33 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:47:33 user nova-compute[74048]:     </rng>
Oct 25 16:47:33 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:47:33 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:47:33 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:47:33 user nova-compute[74048]:     </memballoon>
Oct 25 16:47:33 user nova-compute[74048]:   </devices>
Oct 25 16:47:33 user nova-compute[74048]: </domain>
Oct 25 16:47:33 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1928034511',display_name='tempest-VolumesActionsTest-instance-1928034511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1928034511',id=39,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f61b185ea46741a3a68d7fbea88625f4',ramdisk_id='',reservation_id='r-5ka79uom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1916941863',owner_user_name='tempest-VolumesActionsTest-1916941863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:47:32Z,user_data=None,user_id='94d39f05315c44eb8f5bf10fdb424809',uuid=1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converting VIF {"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG os_vif [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53aab8ff-98f4-5991-b94e-2822a608e20e', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dae4018-03, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dae4018-03, col_values=(('qos', UUID('63d4fab5-e9a6-4dcd-afb1-a0350756433c')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dae4018-03, col_values=(('external_ids', {'iface-id': '5dae4018-03f9-4662-a656-82a3d121fd67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:31:cf', 'vm-uuid': '1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:33 user nova-compute[74048]: INFO os_vif [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03')
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] No VIF found with MAC fa:16:3e:58:31:cf, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Updated VIF entry in instance network info cache for port 5dae4018-03f9-4662-a656-82a3d121fd67. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Updating instance_info_cache with network_info: [{"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:47:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-827732a2-acf7-4659-bfbd-bd3ebfcb5704 req-95d7ec4a-681c-4ba9-a460-59d61396ed6b service nova] Releasing lock "refresh_cache-1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-eb8107e6-17d3-4a66-a009-39a411f1ad74 req-c45faefe-ba1f-47dd-ba79-ce4954de9e12 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-eb8107e6-17d3-4a66-a009-39a411f1ad74 req-c45faefe-ba1f-47dd-ba79-ce4954de9e12 service nova] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-eb8107e6-17d3-4a66-a009-39a411f1ad74 req-c45faefe-ba1f-47dd-ba79-ce4954de9e12 service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-eb8107e6-17d3-4a66-a009-39a411f1ad74 req-c45faefe-ba1f-47dd-ba79-ce4954de9e12 service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-eb8107e6-17d3-4a66-a009-39a411f1ad74 req-c45faefe-ba1f-47dd-ba79-ce4954de9e12 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] No waiting events found dispatching network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:47:34 user nova-compute[74048]: WARNING nova.compute.manager [req-eb8107e6-17d3-4a66-a009-39a411f1ad74 req-c45faefe-ba1f-47dd-ba79-ce4954de9e12 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received unexpected event network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 for instance with vm_state building and task_state spawning.
Oct 25 16:47:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:47:36 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Instance spawned successfully.
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:47:36 user nova-compute[74048]: INFO nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Took 5.16 seconds to spawn the instance on the hypervisor.
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-9e7ce87f-6afb-4d1e-b06b-038662c1f1cf req-ff47de65-e447-4b7e-a7cd-3bf88e5e82ce service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9e7ce87f-6afb-4d1e-b06b-038662c1f1cf req-ff47de65-e447-4b7e-a7cd-3bf88e5e82ce service nova] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9e7ce87f-6afb-4d1e-b06b-038662c1f1cf req-ff47de65-e447-4b7e-a7cd-3bf88e5e82ce service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-9e7ce87f-6afb-4d1e-b06b-038662c1f1cf req-ff47de65-e447-4b7e-a7cd-3bf88e5e82ce service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-9e7ce87f-6afb-4d1e-b06b-038662c1f1cf req-ff47de65-e447-4b7e-a7cd-3bf88e5e82ce service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] No waiting events found dispatching network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:47:36 user nova-compute[74048]: WARNING nova.compute.manager [req-9e7ce87f-6afb-4d1e-b06b-038662c1f1cf req-ff47de65-e447-4b7e-a7cd-3bf88e5e82ce service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received unexpected event network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 for instance with vm_state building and task_state spawning.
Oct 25 16:47:37 user nova-compute[74048]: INFO nova.compute.manager [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Took 5.99 seconds to build instance.
Oct 25 16:47:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f51024b-2dd9-468d-9194-9bf766565cb0 tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.114s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:47:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:47:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:47:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:47:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:47:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:47:49 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:50 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:47:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:47:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:47:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=24.937297821044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d55ba2df-e10c-415f-9caa-3c07a859dfe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:47:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:47:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:47:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:47:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:47:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:47:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [{"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:47:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-54b28e3c-f604-4d30-ac14-805da155813d" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:47:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:47:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:47:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:47:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:48:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:04 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:48:04 user nova-compute[74048]: INFO nova.compute.claims [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Claim successful on node user
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:48:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:48:05 user nova-compute[74048]: INFO nova.virt.block_device [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Booting with volume 4f1a8b34-0402-46d3-a2bb-08c19f92c710 at /dev/vda
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.policy [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef034e25bba42e78a18c07c4e7ec3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2facb7bd1f4b47149df26f9494f180ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG os_brick.utils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2cd5fc-4514-481a-b286-691af0a83be9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[003233b6-5ac4-4666-b96e-837b97f6c08e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af30449-3ce3-4489-ad19-6813917d8c25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1771357-b24d-43a2-9a85-e94f5912f856]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:48:05 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:48:05 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a85b58-0d8a-405a-8ce4-e4efb6f9bc0b]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG os_brick.utils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:48:05 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updating existing volume attachment record: 7a148592-449c-4b81-99f7-a2e74e12fefc {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:48:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Successfully created port: 9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Successfully updated port: 9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquired lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-changed-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Refreshing instance network info cache due to event network-changed-9bec1769-001f-45e8-8f07-8d28bfabc130. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] Acquiring lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updating instance_info_cache with network_info: [{"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Releasing lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Instance network_info: |[{"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] Acquired lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:07 user nova-compute[74048]: DEBUG nova.network.neutron [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Refreshing network info cache for port 9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:48:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updated VIF entry in instance network info cache for port 9bec1769-001f-45e8-8f07-8d28bfabc130. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:48:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updating instance_info_cache with network_info: [{"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8f1a6500-c923-4db8-8011-fe21a9c5cb0e req-87fc679b-7984-4afa-8bf2-0b3d3e9c1ce1 service nova] Releasing lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:48:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Creating image(s)
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Ensure instance console log exists: /opt/stack/data/nova/instances/8290c44f-1342-4172-ae16-b8ac4cc9f238/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Start _get_guest_xml network_info=[{"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '7a148592-449c-4b81-99f7-a2e74e12fefc', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgLVSADR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8290c44f-1342-4172-ae16-b8ac4cc9f238', 'attached_at': '', 'detached_at': '', 'volume_id': '4f1a8b34-0402-46d3-a2bb-08c19f92c710', 'serial': '4f1a8b34-0402-46d3-a2bb-08c19f92c710'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:48:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:48:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgLVSADR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:48:22 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:48:22 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:48:22 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73a68f-ab4a-4b5f-af10-7525e430bb84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:48:22 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[487efcc0-d772-4da1-aef4-36e1d8c5cc5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710] added
Oct 25 16:48:22 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a53a1-d286-4d33-8f1d-9d625a448957]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f79e9-1a2c-44f5-ae7f-fca7a5fbe949]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgLVSADR {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgLVSADR" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b3277-ca89-4923-a919-fe78ae97f59a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgLVSADR'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b267adf-e23c-4685-886b-74fa11343036]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6a2ac-8960-4aa8-9d47-b898b95e2b33]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:23 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:23 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37f87a-e4b8-43e5-8e40-852c7be5c022]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260]
Oct 25 16:48:23 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260] successful.
Oct 25 16:48:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf194113-6610-4cee-ab0a-856a5a652464]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3245b49-fcf8-4c2d-88d4-6953b7bf359a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:23 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:23 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:48:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:23 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:23 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:48:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efc929-d3d8-42f0-9559-ba08d84b7665]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgLVSADR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26436346162633365', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436346162633365', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1544907016',display_name='tempest-TestVolumeBootPattern-server-1544907016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1544907016',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRroVIW4WP8QnZX93hbfJbQq4qAfVxIKH1BVKna5piUodooD3O41S1ik3wovQBHlJN61YMN2ccM3pXh7C+WYFvT7OiYwbcLCij1eRkVnAPyk5cD+ZHqCsh2yaLRftFFHA==',key_name='tempest-TestVolumeBootPattern-749435674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-t2siszfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:48:05Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=8290c44f-1342-4172-ae16-b8ac4cc9f238,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'pci_devices' on Instance uuid 8290c44f-1342-4172-ae16-b8ac4cc9f238 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:48:24 user nova-compute[74048]:   <uuid>8290c44f-1342-4172-ae16-b8ac4cc9f238</uuid>
Oct 25 16:48:24 user nova-compute[74048]:   <name>instance-00000028</name>
Oct 25 16:48:24 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:48:24 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:48:24 user nova-compute[74048]:   <metadata>
Oct 25 16:48:24 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:48:24 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:48:24 user nova-compute[74048]:       <nova:name>tempest-TestVolumeBootPattern-server-1544907016</nova:name>
Oct 25 16:48:24 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:48:22</nova:creationTime>
Oct 25 16:48:24 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:48:24 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:48:24 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:48:24 user nova-compute[74048]:       <nova:owner>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:user uuid="0ef034e25bba42e78a18c07c4e7ec3b2">tempest-TestVolumeBootPattern-1454543820-project-member</nova:user>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:project uuid="2facb7bd1f4b47149df26f9494f180ae">tempest-TestVolumeBootPattern-1454543820</nova:project>
Oct 25 16:48:24 user nova-compute[74048]:       </nova:owner>
Oct 25 16:48:24 user nova-compute[74048]:       <nova:ports>
Oct 25 16:48:24 user nova-compute[74048]:         <nova:port uuid="9bec1769-001f-45e8-8f07-8d28bfabc130">
Oct 25 16:48:24 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 16:48:24 user nova-compute[74048]:         </nova:port>
Oct 25 16:48:24 user nova-compute[74048]:       </nova:ports>
Oct 25 16:48:24 user nova-compute[74048]:     </nova:instance>
Oct 25 16:48:24 user nova-compute[74048]:   </metadata>
Oct 25 16:48:24 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:48:24 user nova-compute[74048]:     <system>
Oct 25 16:48:24 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:48:24 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:48:24 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:48:24 user nova-compute[74048]:       <entry name="serial">8290c44f-1342-4172-ae16-b8ac4cc9f238</entry>
Oct 25 16:48:24 user nova-compute[74048]:       <entry name="uuid">8290c44f-1342-4172-ae16-b8ac4cc9f238</entry>
Oct 25 16:48:24 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:48:24 user nova-compute[74048]:     </system>
Oct 25 16:48:24 user nova-compute[74048]:   </sysinfo>
Oct 25 16:48:24 user nova-compute[74048]:   <os>
Oct 25 16:48:24 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:48:24 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:48:24 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:48:24 user nova-compute[74048]:   </os>
Oct 25 16:48:24 user nova-compute[74048]:   <features>
Oct 25 16:48:24 user nova-compute[74048]:     <acpi/>
Oct 25 16:48:24 user nova-compute[74048]:     <apic/>
Oct 25 16:48:24 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:48:24 user nova-compute[74048]:   </features>
Oct 25 16:48:24 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:48:24 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:48:24 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:48:24 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:48:24 user nova-compute[74048]:   </clock>
Oct 25 16:48:24 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:48:24 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:48:24 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:48:24 user nova-compute[74048]:   </cpu>
Oct 25 16:48:24 user nova-compute[74048]:   <devices>
Oct 25 16:48:24 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:48:24 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:48:24 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:48:24 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:48:24 user nova-compute[74048]:       <serial>4f1a8b34-0402-46d3-a2bb-08c19f92c710</serial>
Oct 25 16:48:24 user nova-compute[74048]:     </disk>
Oct 25 16:48:24 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:48:24 user nova-compute[74048]:       <mac address="fa:16:3e:d9:b4:70"/>
Oct 25 16:48:24 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:48:24 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:48:24 user nova-compute[74048]:       <target dev="tap9bec1769-00"/>
Oct 25 16:48:24 user nova-compute[74048]:     </interface>
Oct 25 16:48:24 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:48:24 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/8290c44f-1342-4172-ae16-b8ac4cc9f238/console.log" append="off"/>
Oct 25 16:48:24 user nova-compute[74048]:     </serial>
Oct 25 16:48:24 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:48:24 user nova-compute[74048]:     <video>
Oct 25 16:48:24 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:48:24 user nova-compute[74048]:     </video>
Oct 25 16:48:24 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:48:24 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:48:24 user nova-compute[74048]:     </rng>
Oct 25 16:48:24 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:48:24 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:48:24 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:48:24 user nova-compute[74048]:     </memballoon>
Oct 25 16:48:24 user nova-compute[74048]:   </devices>
Oct 25 16:48:24 user nova-compute[74048]: </domain>
Oct 25 16:48:24 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1544907016',display_name='tempest-TestVolumeBootPattern-server-1544907016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1544907016',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRroVIW4WP8QnZX93hbfJbQq4qAfVxIKH1BVKna5piUodooD3O41S1ik3wovQBHlJN61YMN2ccM3pXh7C+WYFvT7OiYwbcLCij1eRkVnAPyk5cD+ZHqCsh2yaLRftFFHA==',key_name='tempest-TestVolumeBootPattern-749435674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-t2siszfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:48:05Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=8290c44f-1342-4172-ae16-b8ac4cc9f238,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG os_vif [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea49b57c-d1d1-5124-8de2-5739a6fd8c1a', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bec1769-00, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bec1769-00, col_values=(('qos', UUID('771dc5c5-3b70-426d-81f4-b1e21374a5ac')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bec1769-00, col_values=(('external_ids', {'iface-id': '9bec1769-001f-45e8-8f07-8d28bfabc130', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:b4:70', 'vm-uuid': '8290c44f-1342-4172-ae16-b8ac4cc9f238'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:24 user nova-compute[74048]: INFO os_vif [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00')
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:48:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] No VIF found with MAC fa:16:3e:d9:b4:70, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-03654d03-7abe-4b8e-9a71-8d0275706479 req-aadda7b6-779e-405d-8987-2ddc63ba0baf service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-03654d03-7abe-4b8e-9a71-8d0275706479 req-aadda7b6-779e-405d-8987-2ddc63ba0baf service nova] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-03654d03-7abe-4b8e-9a71-8d0275706479 req-aadda7b6-779e-405d-8987-2ddc63ba0baf service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-03654d03-7abe-4b8e-9a71-8d0275706479 req-aadda7b6-779e-405d-8987-2ddc63ba0baf service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-03654d03-7abe-4b8e-9a71-8d0275706479 req-aadda7b6-779e-405d-8987-2ddc63ba0baf service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] No waiting events found dispatching network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:25 user nova-compute[74048]: WARNING nova.compute.manager [req-03654d03-7abe-4b8e-9a71-8d0275706479 req-aadda7b6-779e-405d-8987-2ddc63ba0baf service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received unexpected event network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 for instance with vm_state building and task_state spawning.
Oct 25 16:48:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:48:27 user nova-compute[74048]: INFO nova.compute.claims [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Claim successful on node user
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.network.neutron [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:48:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.policy [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebdff923d6304b37880ae8bd217f2f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8acd0141444fa2ae4dd9f49267715a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1642c69-badd-4630-a613-6b07a603fac9 req-45a5a0c9-f334-41b4-85dd-d4b447bf4360 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1642c69-badd-4630-a613-6b07a603fac9 req-45a5a0c9-f334-41b4-85dd-d4b447bf4360 service nova] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1642c69-badd-4630-a613-6b07a603fac9 req-45a5a0c9-f334-41b4-85dd-d4b447bf4360 service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b1642c69-badd-4630-a613-6b07a603fac9 req-45a5a0c9-f334-41b4-85dd-d4b447bf4360 service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-b1642c69-badd-4630-a613-6b07a603fac9 req-45a5a0c9-f334-41b4-85dd-d4b447bf4360 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] No waiting events found dispatching network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:27 user nova-compute[74048]: WARNING nova.compute.manager [req-b1642c69-badd-4630-a613-6b07a603fac9 req-45a5a0c9-f334-41b4-85dd-d4b447bf4360 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received unexpected event network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 for instance with vm_state building and task_state spawning.
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:48:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Instance spawned successfully.
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:48:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Creating image(s)
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "/opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "/opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "/opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:28 user nova-compute[74048]: INFO nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Took 5.22 seconds to spawn the instance on the hypervisor.
Oct 25 16:48:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:28 user nova-compute[74048]: INFO nova.compute.manager [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Took 23.29 seconds to build instance.
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5f226fc1-6068-498e-9ad5-78e97a59869f tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.381s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk 1073741824" returned: 0 in 0.050s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG nova.network.neutron [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Successfully created port: f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Cannot resize image /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Ensure instance console log exists: /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Successfully updated port: f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquired lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.neutron [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating instance_info_cache with network_info: [{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Releasing lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Instance network_info: |[{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Start _get_guest_xml network_info=[{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:48:29 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:48:29 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-944157057',display_name='tempest-TestStampPattern-server-944157057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-944157057',id=41,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY/XNxT3bZdfbS7bA8TEGYcJcrnDZXILC+YdYHyiQNZqB7M8VNeazxYLUF69qWftbyUFlAVIUHgkPt223heRLbEHqBn6l2ugX2Ts6mv/TBI7i/pV0nvB9213qET7Ai/mA==',key_name='tempest-TestStampPattern-1069318120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e8acd0141444fa2ae4dd9f49267715a',ramdisk_id='',reservation_id='r-1z5p08p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1148836256',owner_user_name='tempest-TestStampPattern-1148836256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:48:28Z,user_data=None,user_id='ebdff923d6304b37880ae8bd217f2f3a',uuid=35db9646-f68d-4180-94cd-9cce20c0756f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converting VIF {"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.objects.instance [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'pci_devices' on Instance uuid 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:48:29 user nova-compute[74048]:   <uuid>35db9646-f68d-4180-94cd-9cce20c0756f</uuid>
Oct 25 16:48:29 user nova-compute[74048]:   <name>instance-00000029</name>
Oct 25 16:48:29 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:48:29 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:48:29 user nova-compute[74048]:   <metadata>
Oct 25 16:48:29 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:48:29 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:48:29 user nova-compute[74048]:       <nova:name>tempest-TestStampPattern-server-944157057</nova:name>
Oct 25 16:48:29 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:48:29</nova:creationTime>
Oct 25 16:48:29 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:48:29 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:48:29 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:48:29 user nova-compute[74048]:       <nova:owner>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:user uuid="ebdff923d6304b37880ae8bd217f2f3a">tempest-TestStampPattern-1148836256-project-member</nova:user>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:project uuid="8e8acd0141444fa2ae4dd9f49267715a">tempest-TestStampPattern-1148836256</nova:project>
Oct 25 16:48:29 user nova-compute[74048]:       </nova:owner>
Oct 25 16:48:29 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:48:29 user nova-compute[74048]:       <nova:ports>
Oct 25 16:48:29 user nova-compute[74048]:         <nova:port uuid="f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd">
Oct 25 16:48:29 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 16:48:29 user nova-compute[74048]:         </nova:port>
Oct 25 16:48:29 user nova-compute[74048]:       </nova:ports>
Oct 25 16:48:29 user nova-compute[74048]:     </nova:instance>
Oct 25 16:48:29 user nova-compute[74048]:   </metadata>
Oct 25 16:48:29 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:48:29 user nova-compute[74048]:     <system>
Oct 25 16:48:29 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:48:29 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:48:29 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:48:29 user nova-compute[74048]:       <entry name="serial">35db9646-f68d-4180-94cd-9cce20c0756f</entry>
Oct 25 16:48:29 user nova-compute[74048]:       <entry name="uuid">35db9646-f68d-4180-94cd-9cce20c0756f</entry>
Oct 25 16:48:29 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:48:29 user nova-compute[74048]:     </system>
Oct 25 16:48:29 user nova-compute[74048]:   </sysinfo>
Oct 25 16:48:29 user nova-compute[74048]:   <os>
Oct 25 16:48:29 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:48:29 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:48:29 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:48:29 user nova-compute[74048]:   </os>
Oct 25 16:48:29 user nova-compute[74048]:   <features>
Oct 25 16:48:29 user nova-compute[74048]:     <acpi/>
Oct 25 16:48:29 user nova-compute[74048]:     <apic/>
Oct 25 16:48:29 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:48:29 user nova-compute[74048]:   </features>
Oct 25 16:48:29 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:48:29 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:48:29 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:48:29 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:48:29 user nova-compute[74048]:   </clock>
Oct 25 16:48:29 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:48:29 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:48:29 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:48:29 user nova-compute[74048]:   </cpu>
Oct 25 16:48:29 user nova-compute[74048]:   <devices>
Oct 25 16:48:29 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:48:29 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:48:29 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk"/>
Oct 25 16:48:29 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:48:29 user nova-compute[74048]:     </disk>
Oct 25 16:48:29 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:48:29 user nova-compute[74048]:       <mac address="fa:16:3e:5e:10:02"/>
Oct 25 16:48:29 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:48:29 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:48:29 user nova-compute[74048]:       <target dev="tapf0f2bb69-1c"/>
Oct 25 16:48:29 user nova-compute[74048]:     </interface>
Oct 25 16:48:29 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:48:29 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/console.log" append="off"/>
Oct 25 16:48:29 user nova-compute[74048]:     </serial>
Oct 25 16:48:29 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:48:29 user nova-compute[74048]:     <video>
Oct 25 16:48:29 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:48:29 user nova-compute[74048]:     </video>
Oct 25 16:48:29 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:48:29 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:48:29 user nova-compute[74048]:     </rng>
Oct 25 16:48:29 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:48:29 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:48:29 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:48:29 user nova-compute[74048]:     </memballoon>
Oct 25 16:48:29 user nova-compute[74048]:   </devices>
Oct 25 16:48:29 user nova-compute[74048]: </domain>
Oct 25 16:48:29 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-944157057',display_name='tempest-TestStampPattern-server-944157057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-944157057',id=41,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY/XNxT3bZdfbS7bA8TEGYcJcrnDZXILC+YdYHyiQNZqB7M8VNeazxYLUF69qWftbyUFlAVIUHgkPt223heRLbEHqBn6l2ugX2Ts6mv/TBI7i/pV0nvB9213qET7Ai/mA==',key_name='tempest-TestStampPattern-1069318120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e8acd0141444fa2ae4dd9f49267715a',ramdisk_id='',reservation_id='r-1z5p08p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1148836256',owner_user_name='tempest-TestStampPattern-1148836256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:48:28Z,user_data=None,user_id='ebdff923d6304b37880ae8bd217f2f3a',uuid=35db9646-f68d-4180-94cd-9cce20c0756f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converting VIF {"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG os_vif [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bc8e7b6-c983-5b44-a1f2-b44c649df3f5', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f2bb69-1c, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0f2bb69-1c, col_values=(('qos', UUID('54262b10-91c5-4586-85e9-3b2b38ca2c0d')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0f2bb69-1c, col_values=(('external_ids', {'iface-id': 'f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:10:02', 'vm-uuid': '35db9646-f68d-4180-94cd-9cce20c0756f'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:29 user nova-compute[74048]: INFO os_vif [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c')
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No VIF found with MAC fa:16:3e:5e:10:02, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-changed-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Refreshing instance network info cache due to event network-changed-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] Acquiring lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] Acquired lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:29 user nova-compute[74048]: DEBUG nova.network.neutron [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Refreshing network info cache for port f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:48:30 user nova-compute[74048]: DEBUG nova.network.neutron [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updated VIF entry in instance network info cache for port f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:48:30 user nova-compute[74048]: DEBUG nova.network.neutron [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating instance_info_cache with network_info: [{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:30 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ceb725aa-5e3c-4171-a7d1-946f206f86e5 req-dc4bc323-d326-4b2f-97a9-e9a4281eb480 service nova] Releasing lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-changed-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Refreshing instance network info cache due to event network-changed-d3c8049b-bdc5-494f-aa5f-036fb3218564. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Refreshing network info cache for port d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] No waiting events found dispatching network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:31 user nova-compute[74048]: WARNING nova.compute.manager [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received unexpected event network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd for instance with vm_state building and task_state spawning.
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] No waiting events found dispatching network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:31 user nova-compute[74048]: WARNING nova.compute.manager [req-59821cc4-16d9-4c3e-8e7c-09f82c5feaa3 req-2df42698-7945-4bb5-a5a8-9c655a924a57 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received unexpected event network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd for instance with vm_state building and task_state spawning.
Oct 25 16:48:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updated VIF entry in instance network info cache for port d3c8049b-bdc5-494f-aa5f-036fb3218564. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:48:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f43c14f-65ac-4f91-95da-5253e3f141be req-a34806e4-c023-4735-8a0c-5290c12e564c service nova] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:48:33 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Instance spawned successfully.
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:48:33 user nova-compute[74048]: INFO nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 25 16:48:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:48:33 user nova-compute[74048]: INFO nova.compute.manager [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Took 6.39 seconds to build instance.
Oct 25 16:48:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-761fff2d-4dba-4393-b5e9-9942ed48e9da tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.485s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:34 user nova-compute[74048]: INFO nova.compute.manager [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Unrescuing
Oct 25 16:48:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquired lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:34 user nova-compute[74048]: DEBUG nova.network.neutron [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG nova.network.neutron [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updating instance_info_cache with network_info: [{"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Releasing lock "refresh_cache-d55ba2df-e10c-415f-9caa-3c07a859dfe2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG nova.objects.instance [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'flavor' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-ae402bf4-5eed-4e06-9026-eff3dd38835a req-1716f6ea-424c-4529-8407-2a72e6fdae26 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ae402bf4-5eed-4e06-9026-eff3dd38835a req-1716f6ea-424c-4529-8407-2a72e6fdae26 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ae402bf4-5eed-4e06-9026-eff3dd38835a req-1716f6ea-424c-4529-8407-2a72e6fdae26 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ae402bf4-5eed-4e06-9026-eff3dd38835a req-1716f6ea-424c-4529-8407-2a72e6fdae26 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:35 user nova-compute[74048]: DEBUG nova.compute.manager [req-ae402bf4-5eed-4e06-9026-eff3dd38835a req-1716f6ea-424c-4529-8407-2a72e6fdae26 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:35 user nova-compute[74048]: WARNING nova.compute.manager [req-ae402bf4-5eed-4e06-9026-eff3dd38835a req-1716f6ea-424c-4529-8407-2a72e6fdae26 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:48:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:35 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance destroyed successfully.
Oct 25 16:48:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-fe1a95fc-deda-48c3-9f29-7b2bb1332872 req-b83f3149-dde4-4315-8f92-16f689008525 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fe1a95fc-deda-48c3-9f29-7b2bb1332872 req-b83f3149-dde4-4315-8f92-16f689008525 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fe1a95fc-deda-48c3-9f29-7b2bb1332872 req-b83f3149-dde4-4315-8f92-16f689008525 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fe1a95fc-deda-48c3-9f29-7b2bb1332872 req-b83f3149-dde4-4315-8f92-16f689008525 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG nova.compute.manager [req-fe1a95fc-deda-48c3-9f29-7b2bb1332872 req-b83f3149-dde4-4315-8f92-16f689008525 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:37 user nova-compute[74048]: WARNING nova.compute.manager [req-fe1a95fc-deda-48c3-9f29-7b2bb1332872 req-b83f3149-dde4-4315-8f92-16f689008525 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:48:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG nova.objects.instance [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:38 user nova-compute[74048]: INFO nova.compute.manager [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Attaching volume fbaabef9-6d7f-44d5-87b8-a2690e072b45 to /dev/vdb
Oct 25 16:48:38 user nova-compute[74048]: DEBUG os_brick.utils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c29c0ac-f4bd-4ff9-9d0a-d709b027951d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d722f1f9-62d4-470f-b4b8-b79ce1892470]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00eb488-4437-4220-861b-f16b944d814e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7ebd6-bfe7-4c7a-a24e-ecb5febf6beb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:48:38 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:48:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3897969f-2f89-4f5c-a773-6faedc0a45d0]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG os_brick.utils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:48:38 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating existing volume attachment record: 200a4d07-04e6-49f2-964e-854f79b0a855 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:39 user nova-compute[74048]: WARNING nova.compute.manager [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:48:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG nova.compute.manager [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:48:39 user nova-compute[74048]: WARNING nova.compute.manager [req-ca25b682-a2b9-4e3c-b69f-859d36e2afe0 req-9ed1b608-f5cd-49d1-98e0-55366908d613 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state rescued and task_state unrescuing.
Oct 25 16:48:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:39 user nova-compute[74048]: DEBUG nova.compute.manager [None req-48465bb8-a870-4740-9f6d-e4a993a84336 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:48:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:47 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:48 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:48 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:48:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:51 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:51 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:52 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:48:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:48:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7651MB free_disk=24.94499969482422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d55ba2df-e10c-415f-9caa-3c07a859dfe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8290c44f-1342-4172-ae16-b8ac4cc9f238 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:48:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:48:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:48:56 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b67cd0-494a-4b6d-a3d2-9fb5f7300b28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:48:56 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be97b3-9bde-4ef1-8d3c-c8b186e2b289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45] added
Oct 25 16:48:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebac20c-c253-484c-b782-901b92267271]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed14227-3fd3-4c29-a977-3db77b1259bc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWHvraNX {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWHvraNX" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[178797eb-df15-40a1-ac5f-a5622f386f68]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OWHvraNX'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e9ddaf-3a0a-4ac8-9483-5613f6038f0e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8df582-f4cf-4001-b7ae-b827af6cf0be]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f67ce-eae1-445a-b997-98fdc09f5123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]
Oct 25 16:48:57 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.
Oct 25 16:48:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efeb7fb-d286-43be-ac3e-f59ca449d72b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bd2853-1c61-41de-91a2-00a627f15ef4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:48:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78dfd8-1024-468f-ba47-3399cba0a432]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:48:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23732366466643639', 'path': '/dev/sde'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732366466643639', 'path': '/dev/sde'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:48:58 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:48:58 user nova-compute[74048]:   <source dev="/dev/sde"/>
Oct 25 16:48:58 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:48:58 user nova-compute[74048]:   <serial>fbaabef9-6d7f-44d5-87b8-a2690e072b45</serial>
Oct 25 16:48:58 user nova-compute[74048]: </disk>
Oct 25 16:48:58 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No VIF found with MAC fa:16:3e:54:94:ad, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:48:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-638cf4fd-92ff-41bb-8387-ed5bc217b1ff tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.662s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Updating instance_info_cache with network_info: [{"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-b5e77341-b320-41e8-aa75-f74052b893cb" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74048) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 16:48:59 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-da273f2c-06b2-494d-84bc-4f36e3bf4ed1 req-8ee85a57-4fd1-4d8b-8ec0-8d4aae570469 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da273f2c-06b2-494d-84bc-4f36e3bf4ed1 req-8ee85a57-4fd1-4d8b-8ec0-8d4aae570469 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da273f2c-06b2-494d-84bc-4f36e3bf4ed1 req-8ee85a57-4fd1-4d8b-8ec0-8d4aae570469 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-da273f2c-06b2-494d-84bc-4f36e3bf4ed1 req-8ee85a57-4fd1-4d8b-8ec0-8d4aae570469 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-da273f2c-06b2-494d-84bc-4f36e3bf4ed1 req-8ee85a57-4fd1-4d8b-8ec0-8d4aae570469 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:49:00 user nova-compute[74048]: WARNING nova.compute.manager [req-da273f2c-06b2-494d-84bc-4f36e3bf4ed1 req-8ee85a57-4fd1-4d8b-8ec0-8d4aae570469 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state active and task_state powering-off.
Oct 25 16:49:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance destroyed successfully.
Oct 25 16:49:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f5982c77-efd5-4c67-8956-7db5f2dc0446 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-5144eb7b-0816-4d93-9458-97028586174e req-226ec92c-db5d-4420-aa92-377d4ac74c68 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5144eb7b-0816-4d93-9458-97028586174e req-226ec92c-db5d-4420-aa92-377d4ac74c68 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5144eb7b-0816-4d93-9458-97028586174e req-226ec92c-db5d-4420-aa92-377d4ac74c68 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5144eb7b-0816-4d93-9458-97028586174e req-226ec92c-db5d-4420-aa92-377d4ac74c68 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-5144eb7b-0816-4d93-9458-97028586174e req-226ec92c-db5d-4420-aa92-377d4ac74c68 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:49:02 user nova-compute[74048]: WARNING nova.compute.manager [req-5144eb7b-0816-4d93-9458-97028586174e req-226ec92c-db5d-4420-aa92-377d4ac74c68 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state stopped and task_state None.
Oct 25 16:49:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:21 user nova-compute[74048]: INFO nova.compute.manager [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Terminating instance
Oct 25 16:49:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-99401144-dd00-4043-b02d-48cdcf64dbce req-1d0009be-a569-4df2-b930-795f7cb7da07 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-vif-unplugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-99401144-dd00-4043-b02d-48cdcf64dbce req-1d0009be-a569-4df2-b930-795f7cb7da07 service nova] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-99401144-dd00-4043-b02d-48cdcf64dbce req-1d0009be-a569-4df2-b930-795f7cb7da07 service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-99401144-dd00-4043-b02d-48cdcf64dbce req-1d0009be-a569-4df2-b930-795f7cb7da07 service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-99401144-dd00-4043-b02d-48cdcf64dbce req-1d0009be-a569-4df2-b930-795f7cb7da07 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] No waiting events found dispatching network-vif-unplugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-99401144-dd00-4043-b02d-48cdcf64dbce req-1d0009be-a569-4df2-b930-795f7cb7da07 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-vif-unplugged-5dae4018-03f9-4662-a656-82a3d121fd67 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Instance destroyed successfully.
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lazy-loading 'resources' on Instance uuid 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1928034511',display_name='tempest-VolumesActionsTest-instance-1928034511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1928034511',id=39,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f61b185ea46741a3a68d7fbea88625f4',ramdisk_id='',reservation_id='r-5ka79uom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1916941863',owner_user_name='tempest-VolumesActionsTest-1916941863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:47:37Z,user_data=None,user_id='94d39f05315c44eb8f5bf10fdb424809',uuid=1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converting VIF {"id": "5dae4018-03f9-4662-a656-82a3d121fd67", "address": "fa:16:3e:58:31:cf", "network": {"id": "ef60407f-91a9-4075-98d8-694af60c6d36", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1406472591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f61b185ea46741a3a68d7fbea88625f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dae4018-03", "ovs_interfaceid": "5dae4018-03f9-4662-a656-82a3d121fd67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG os_vif [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dae4018-03, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63d4fab5-e9a6-4dcd-afb1-a0350756433c) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:22 user nova-compute[74048]: INFO os_vif [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:31:cf,bridge_name='br-int',has_traffic_filtering=True,id=5dae4018-03f9-4662-a656-82a3d121fd67,network=Network(ef60407f-91a9-4075-98d8-694af60c6d36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dae4018-03')
Oct 25 16:49:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Deleting instance files /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd_del
Oct 25 16:49:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Deletion of /opt/stack/data/nova/instances/1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd_del complete
Oct 25 16:49:22 user nova-compute[74048]: INFO nova.compute.manager [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 25 16:49:22 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:49:22 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Took 0.47 seconds to deallocate network for instance.
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-a8159354-ebc0-4b00-8fb7-d0116e2e9350 req-47c93aa7-bf93-45c8-ab61-2583cd5f3276 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-vif-deleted-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:22 user nova-compute[74048]: INFO nova.compute.manager [req-a8159354-ebc0-4b00-8fb7-d0116e2e9350 req-47c93aa7-bf93-45c8-ab61-2583cd5f3276 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Neutron deleted interface 5dae4018-03f9-4662-a656-82a3d121fd67; detaching it from the instance and deleting it from the info cache
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.network.neutron [req-a8159354-ebc0-4b00-8fb7-d0116e2e9350 req-47c93aa7-bf93-45c8-ab61-2583cd5f3276 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:49:22 user nova-compute[74048]: DEBUG nova.compute.manager [req-a8159354-ebc0-4b00-8fb7-d0116e2e9350 req-47c93aa7-bf93-45c8-ab61-2583cd5f3276 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Detach interface failed, port_id=5dae4018-03f9-4662-a656-82a3d121fd67, reason: Instance 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:49:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:23 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:49:23 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:49:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:23 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Deleted allocations for instance 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd
Oct 25 16:49:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e7406c-ddf1-43cf-a472-f26a76d3970a tempest-VolumesActionsTest-1916941863 tempest-VolumesActionsTest-1916941863-project-member] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-b04521a7-4ab7-4573-8cab-edf4fdc4484a req-9736ff0b-3db0-408f-b691-284264c0b582 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received event network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b04521a7-4ab7-4573-8cab-edf4fdc4484a req-9736ff0b-3db0-408f-b691-284264c0b582 service nova] Acquiring lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b04521a7-4ab7-4573-8cab-edf4fdc4484a req-9736ff0b-3db0-408f-b691-284264c0b582 service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b04521a7-4ab7-4573-8cab-edf4fdc4484a req-9736ff0b-3db0-408f-b691-284264c0b582 service nova] Lock "1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-b04521a7-4ab7-4573-8cab-edf4fdc4484a req-9736ff0b-3db0-408f-b691-284264c0b582 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] No waiting events found dispatching network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:49:24 user nova-compute[74048]: WARNING nova.compute.manager [req-b04521a7-4ab7-4573-8cab-edf4fdc4484a req-9736ff0b-3db0-408f-b691-284264c0b582 service nova] [instance: 1e98d16e-ecbd-43fe-9efb-7d912b3fdbdd] Received unexpected event network-vif-plugged-5dae4018-03f9-4662-a656-82a3d121fd67 for instance with vm_state deleted and task_state None.
Oct 25 16:49:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:49 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:52 user nova-compute[74048]: INFO nova.compute.manager [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Terminating instance
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] During wait destroy, instance disappeared. {{(pid=74048) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Oct 25 16:49:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Instance destroyed successfully.
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'resources' on Instance uuid 4a970e43-ae6e-46fc-a5e7-173012590ca7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2127080201',display_name='tempest-ServerActionsTestOtherA-server-2116857339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2127080201',id=12,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF/Ob8zVZV2VbmuGOLtxWdy/S5pTQppE8p4hDAWaGtFkeEynINdBiyI+HYRih4nviB5WYM5HaOiWdBqdpoYiqM9tKvfSHL3HINtv/rMFMfN2/npkh4X3j7Ak4lcCS9t0w==',key_name='tempest-keypair-204708746',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-30sp9xr6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:41:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=4a970e43-ae6e-46fc-a5e7-173012590ca7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "address": "fa:16:3e:b6:87:5d", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56d3478b-94", "ovs_interfaceid": "56d3478b-943a-4c3b-9864-0b6e4c519e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_vif [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56d3478b-94, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:49:52 user nova-compute[74048]: INFO os_vif [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:87:5d,bridge_name='br-int',has_traffic_filtering=True,id=56d3478b-943a-4c3b-9864-0b6e4c519e4a,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56d3478b-94')
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAjPEKzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:49:52 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdca594-679b-4b13-b4ff-c3fd4d45ed57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:49:52 user nova-compute[74048]: No targets found.
Oct 25 16:49:52 user nova-compute[74048]: iSNS:
Oct 25 16:49:52 user nova-compute[74048]: No targets found.
Oct 25 16:49:52 user nova-compute[74048]: STATIC:
Oct 25 16:49:52 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:49:52 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:52 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:52 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:49:52 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:52 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:52 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:49:52 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:52 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:52 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710
Oct 25 16:49:52 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:52 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:52 user nova-compute[74048]: FIRMWARE:
Oct 25 16:49:52 user nova-compute[74048]: No targets found.
Oct 25 16:49:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:49:52 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:49:52 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4df2d27b-827d-4abc-a28c-f2d5c1cf954b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5495f44c-1198-4965-982e-eef61bd3f43a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33d995e-323a-4da6-b104-d8c4f524fe43]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:49:52 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:49:52 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:49:52 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:49:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:49:52 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:49:52 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:49:52 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:49:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18502b4ca0>, {}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Disconnecting from: [] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== disconnect_volume: return (77ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:49:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Deletion of /opt/stack/data/nova/instances/4a970e43-ae6e-46fc-a5e7-173012590ca7_del complete
Oct 25 16:49:52 user nova-compute[74048]: INFO nova.compute.manager [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Took 0.16 seconds to destroy the instance on the hypervisor.
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:49:53 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Took 0.80 seconds to deallocate network for instance.
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-f2ea7cd5-c7a4-4a20-8ab9-41d75c6d8835 req-67f43d2d-fef6-4cfe-8c1e-c5345a490484 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Received event network-vif-deleted-56d3478b-943a-4c3b-9864-0b6e4c519e4a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:53 user nova-compute[74048]: INFO nova.compute.manager [req-f2ea7cd5-c7a4-4a20-8ab9-41d75c6d8835 req-67f43d2d-fef6-4cfe-8c1e-c5345a490484 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Neutron deleted interface 56d3478b-943a-4c3b-9864-0b6e4c519e4a; detaching it from the instance and deleting it from the info cache
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-f2ea7cd5-c7a4-4a20-8ab9-41d75c6d8835 req-67f43d2d-fef6-4cfe-8c1e-c5345a490484 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-f2ea7cd5-c7a4-4a20-8ab9-41d75c6d8835 req-67f43d2d-fef6-4cfe-8c1e-c5345a490484 service nova] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Detach interface failed, port_id=56d3478b-943a-4c3b-9864-0b6e4c519e4a, reason: Instance 4a970e43-ae6e-46fc-a5e7-173012590ca7 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:49:53 user nova-compute[74048]: INFO nova.compute.manager [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 4a970e43-ae6e-46fc-a5e7-173012590ca7] Took 0.09 seconds to detach 1 volumes for instance.
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:53 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9afc01d5-dd6c-4d1c-81bc-ddd1ddd85515 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "4a970e43-ae6e-46fc-a5e7-173012590ca7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.533s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:49:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-changed-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Refreshing instance network info cache due to event network-changed-9bec1769-001f-45e8-8f07-8d28bfabc130. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] Acquiring lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] Acquired lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.network.neutron [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Refreshing network info cache for port 9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:49:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:49:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=7963MB free_disk=24.961692810058594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d55ba2df-e10c-415f-9caa-3c07a859dfe2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8290c44f-1342-4172-ae16-b8ac4cc9f238 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:49:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updated VIF entry in instance network info cache for port 9bec1769-001f-45e8-8f07-8d28bfabc130. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updating instance_info_cache with network_info: [{"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5a56f21f-5060-4591-8b93-eebeacc23395 req-aad0670f-6736-4143-a486-1b64daed44d2 service nova] Releasing lock "refresh_cache-8290c44f-1342-4172-ae16-b8ac4cc9f238" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:49:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4822-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:58 user nova-compute[74048]: INFO nova.compute.manager [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Terminating instance
Oct 25 16:49:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-600fd535-3fa1-4d48-81db-105283127899 req-914d1321-9ef7-480a-98c0-ce686e1a1215 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-vif-unplugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-600fd535-3fa1-4d48-81db-105283127899 req-914d1321-9ef7-480a-98c0-ce686e1a1215 service nova] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-600fd535-3fa1-4d48-81db-105283127899 req-914d1321-9ef7-480a-98c0-ce686e1a1215 service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-600fd535-3fa1-4d48-81db-105283127899 req-914d1321-9ef7-480a-98c0-ce686e1a1215 service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-600fd535-3fa1-4d48-81db-105283127899 req-914d1321-9ef7-480a-98c0-ce686e1a1215 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] No waiting events found dispatching network-vif-unplugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:49:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-600fd535-3fa1-4d48-81db-105283127899 req-914d1321-9ef7-480a-98c0-ce686e1a1215 service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-vif-unplugged-9bec1769-001f-45e8-8f07-8d28bfabc130 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:49:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Instance destroyed successfully.
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.objects.instance [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lazy-loading 'resources' on Instance uuid 8290c44f-1342-4172-ae16-b8ac4cc9f238 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1544907016',display_name='tempest-TestVolumeBootPattern-server-1544907016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1544907016',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRroVIW4WP8QnZX93hbfJbQq4qAfVxIKH1BVKna5piUodooD3O41S1ik3wovQBHlJN61YMN2ccM3pXh7C+WYFvT7OiYwbcLCij1eRkVnAPyk5cD+ZHqCsh2yaLRftFFHA==',key_name='tempest-TestVolumeBootPattern-749435674',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-t2siszfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:48:28Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=8290c44f-1342-4172-ae16-b8ac4cc9f238,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "9bec1769-001f-45e8-8f07-8d28bfabc130", "address": "fa:16:3e:d9:b4:70", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bec1769-00", "ovs_interfaceid": "9bec1769-001f-45e8-8f07-8d28bfabc130", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_vif [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bec1769-00, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=771dc5c5-3b70-426d-81f4-b1e21374a5ac) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:49:59 user nova-compute[74048]: INFO os_vif [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:b4:70,bridge_name='br-int',has_traffic_filtering=True,id=9bec1769-001f-45e8-8f07-8d28bfabc130,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bec1769-00')
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgLVSADR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:49:59 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd0ea55-2fa2-4c49-ad0b-f2cea665bc8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:49:59 user nova-compute[74048]: No targets found.
Oct 25 16:49:59 user nova-compute[74048]: iSNS:
Oct 25 16:49:59 user nova-compute[74048]: No targets found.
Oct 25 16:49:59 user nova-compute[74048]: STATIC:
Oct 25 16:49:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:49:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:49:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:49:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:59 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710
Oct 25 16:49:59 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:49:59 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:49:59 user nova-compute[74048]: FIRMWARE:
Oct 25 16:49:59 user nova-compute[74048]: No targets found.
Oct 25 16:49:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:49:59 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:49:59 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa281e05-1a0e-4759-aeb4-175ceab28ede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1f5be-3270-4a8b-80c9-99cc90e7ce26]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:49:59 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:49:59 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:49:59 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:49:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:49:59 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:49:59 user nova-compute[74048]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 (non-flash)
Oct 25 16:49:59 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:49:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840379870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[003885c4-30a9-4bd3-a5b4-7f1fa2e6fd21]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7161af7c-76d9-45bf-850f-aae8a32fe317]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c791b14f-8a92-4078-a31d-4bc14c6544e7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d52c3-14eb-42b5-8857-2212d8a4ee79]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26436346162633365', '/dev/disk/by-id/scsi-1SCST_BIOa64f8aaa-d64abc3e1fc625d4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a64f8aaa') {{(pid=85401) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 16:49:59 user nova-compute[74048]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26436346162633365
Oct 25 16:49:59 user nova-compute[74048]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa64f8aaa-d64abc3e1fc625d4
Oct 25 16:49:59 user nova-compute[74048]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a64f8aaa
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec83a78-6147-44da-8200-939ab7537ab9]: (4, None) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bfacde-45be-4fcc-8a17-c00485be54e0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e6d89b-81f4-46f8-aee3-0fc8020967d7]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260]
Oct 25 16:49:59 user nova-compute[74048]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710, portal: 172.16.0.220,3260] successful.
Oct 25 16:49:59 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1a8b34-0402-46d3-a2bb-08c19f92c710 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a046cf30-6195-47fb-b494-b4163364fd23]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== disconnect_volume: return (341ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:49:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Deleting instance files /opt/stack/data/nova/instances/8290c44f-1342-4172-ae16-b8ac4cc9f238_del
Oct 25 16:49:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Deletion of /opt/stack/data/nova/instances/8290c44f-1342-4172-ae16-b8ac4cc9f238_del complete
Oct 25 16:49:59 user nova-compute[74048]: INFO nova.compute.manager [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Updating instance_info_cache with network_info: [{"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:49:59 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:50:00 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Took 0.87 seconds to deallocate network for instance.
Oct 25 16:50:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] Acquiring lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] No waiting events found dispatching network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:50:00 user nova-compute[74048]: WARNING nova.compute.manager [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received unexpected event network-vif-plugged-9bec1769-001f-45e8-8f07-8d28bfabc130 for instance with vm_state active and task_state deleting.
Oct 25 16:50:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-83581780-6cb5-4166-87f5-baf14ce601dd req-534737cd-ca0f-43e4-9631-973d7710a02f service nova] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Received event network-vif-deleted-9bec1769-001f-45e8-8f07-8d28bfabc130 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:01 user nova-compute[74048]: INFO nova.compute.manager [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: 8290c44f-1342-4172-ae16-b8ac4cc9f238] Took 0.79 seconds to detach 1 volumes for instance.
Oct 25 16:50:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:01 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:50:01 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:50:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:01 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Deleted allocations for instance 8290c44f-1342-4172-ae16-b8ac4cc9f238
Oct 25 16:50:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-7c283794-8216-41ff-961c-aa05ce73c5b8 tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "8290c44f-1342-4172-ae16-b8ac4cc9f238" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.312s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:50:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:50:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:50:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-changed-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Refreshing instance network info cache due to event network-changed-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:50:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] Acquiring lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:50:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] Acquired lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:50:18 user nova-compute[74048]: DEBUG nova.network.neutron [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Refreshing network info cache for port f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:50:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updated VIF entry in instance network info cache for port f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:50:19 user nova-compute[74048]: DEBUG nova.network.neutron [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating instance_info_cache with network_info: [{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:50:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d299e436-9e7e-430b-baed-5247926dae92 req-85923c47-8f62-4c45-a525-c173855b8e7f service nova] Releasing lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'flavor' on Instance uuid 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:20 user nova-compute[74048]: INFO nova.compute.manager [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Attaching volume 7defa66c-f0d6-4c6f-acf8-f370ee30823b to /dev/vdb
Oct 25 16:50:20 user nova-compute[74048]: DEBUG os_brick.utils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e49de-d99c-4385-987c-29f00be35cbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b38d02-cc5c-49f8-8dec-24274834c838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a8d08f-8230-40ae-b0d5-dce760164394]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba56a00-425c-4e76-94d6-d8da31c0bc0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:50:20 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:50:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d757bbe-07f8-45ab-b4dd-accae1dfa236]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG os_brick.utils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:50:20 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating existing volume attachment record: f511ee13-31d4-43c5-9859-d08258a818a1 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:50:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:25 user nova-compute[74048]: INFO nova.compute.manager [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Terminating instance
Oct 25 16:50:25 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-a53cb24e-fd3e-4e7c-92c5-59949f4507a0 req-2dfa31e5-ae97-4183-a862-531df86e0842 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a53cb24e-fd3e-4e7c-92c5-59949f4507a0 req-2dfa31e5-ae97-4183-a862-531df86e0842 service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a53cb24e-fd3e-4e7c-92c5-59949f4507a0 req-2dfa31e5-ae97-4183-a862-531df86e0842 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a53cb24e-fd3e-4e7c-92c5-59949f4507a0 req-2dfa31e5-ae97-4183-a862-531df86e0842 service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-a53cb24e-fd3e-4e7c-92c5-59949f4507a0 req-2dfa31e5-ae97-4183-a862-531df86e0842 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:50:25 user nova-compute[74048]: DEBUG nova.compute.manager [req-a53cb24e-fd3e-4e7c-92c5-59949f4507a0 req-2dfa31e5-ae97-4183-a862-531df86e0842 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-unplugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Instance destroyed successfully.
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'resources' on Instance uuid d55ba2df-e10c-415f-9caa-3c07a859dfe2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:44:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-325270038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-325270038',id=36,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-tiff35np',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:48:40Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d55ba2df-e10c-415f-9caa-3c07a859dfe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "a7203e06-7480-4963-9eb3-469776bd8428", "address": "fa:16:3e:4b:04:eb", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7203e06-74", "ovs_interfaceid": "a7203e06-7480-4963-9eb3-469776bd8428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_vif [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7203e06-74, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc93650e-be22-4ab0-96f6-dca35de3c15e) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:26 user nova-compute[74048]: INFO os_vif [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:04:eb,bridge_name='br-int',has_traffic_filtering=True,id=a7203e06-7480-4963-9eb3-469776bd8428,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7203e06-74')
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEBqdvLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:50:26 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a0a174-547a-4199-8d46-80cf8f041c53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:50:26 user nova-compute[74048]: No targets found.
Oct 25 16:50:26 user nova-compute[74048]: iSNS:
Oct 25 16:50:26 user nova-compute[74048]: No targets found.
Oct 25 16:50:26 user nova-compute[74048]: STATIC:
Oct 25 16:50:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b
Oct 25 16:50:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:50:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:50:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:50:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:50:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:50:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:50:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:50:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:50:26 user nova-compute[74048]: FIRMWARE:
Oct 25 16:50:26 user nova-compute[74048]: No targets found.
Oct 25 16:50:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:50:26 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:50:26 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9de128-beaf-463a-93f4-b285ac0a4ab9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6116fe1-4ded-45ae-936b-45048626c638]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:26 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:50:26 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:26 user nova-compute[74048]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b (non-flash)
Oct 25 16:50:26 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185024dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a312bbf-2ebd-4411-a2b2-f8fba612d647]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f49722-c051-48f4-ae1d-75fb54f88767]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e3404f-38e9-4542-979e-315901c4c2f1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.080s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99e3793-d1a7-4d25-96a9-244406c5a555]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ed7330-3724-4ac2-8913-99f0f5765d2a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728ccbe-aa11-44d0-ac90-5ecf0c0f549a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260]
Oct 25 16:50:26 user nova-compute[74048]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b, portal: 172.16.0.220,3260] successful.
Oct 25 16:50:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17574fb2-fc85-4925-9b7e-859d681b2d0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19368d-75f7-49d0-8622-a28c3f7897ba]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== disconnect_volume: return (331ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:50:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Deleting instance files /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2_del
Oct 25 16:50:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Deletion of /opt/stack/data/nova/instances/d55ba2df-e10c-415f-9caa-3c07a859dfe2_del complete
Oct 25 16:50:26 user nova-compute[74048]: INFO nova.compute.manager [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 25 16:50:26 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:50:26 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:50:27 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:50:27 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Took 0.43 seconds to deallocate network for instance.
Oct 25 16:50:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-f2d0b1ee-8e55-4344-beba-5a13e2099846 req-86501df0-d181-467c-9b5e-421233981586 service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-deleted-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-a83b4f0c-a54a-48a4-a73a-cd8eabbd4e4c req-d6f4784f-8701-4b99-8058-265a89c4317c service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a83b4f0c-a54a-48a4-a73a-cd8eabbd4e4c req-d6f4784f-8701-4b99-8058-265a89c4317c service nova] Acquiring lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a83b4f0c-a54a-48a4-a73a-cd8eabbd4e4c req-d6f4784f-8701-4b99-8058-265a89c4317c service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a83b4f0c-a54a-48a4-a73a-cd8eabbd4e4c req-d6f4784f-8701-4b99-8058-265a89c4317c service nova] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:28 user nova-compute[74048]: DEBUG nova.compute.manager [req-a83b4f0c-a54a-48a4-a73a-cd8eabbd4e4c req-d6f4784f-8701-4b99-8058-265a89c4317c service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] No waiting events found dispatching network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:50:28 user nova-compute[74048]: WARNING nova.compute.manager [req-a83b4f0c-a54a-48a4-a73a-cd8eabbd4e4c req-d6f4784f-8701-4b99-8058-265a89c4317c service nova] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Received unexpected event network-vif-plugged-a7203e06-7480-4963-9eb3-469776bd8428 for instance with vm_state active and task_state deleting.
Oct 25 16:50:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:32 user nova-compute[74048]: INFO nova.compute.manager [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d55ba2df-e10c-415f-9caa-3c07a859dfe2] Took 4.94 seconds to detach 1 volumes for instance.
Oct 25 16:50:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:32 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:50:32 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:50:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:32 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Deleted allocations for instance d55ba2df-e10c-415f-9caa-3c07a859dfe2
Oct 25 16:50:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b6a591ea-1fe3-4e74-a2e9-70568a3f6d63 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d55ba2df-e10c-415f-9caa-3c07a859dfe2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.067s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKqeElhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:50:38 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:50:38 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:50:38 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1077b785-bede-4ee3-a857-e70136b60b0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:50:38 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e69a24-f74a-4b81-999e-d09ca9fa321d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b] added
Oct 25 16:50:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd15c5f-6ec7-41b5-a983-498cae2755e5]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9763ede5-11c7-4233-bce5-1151bdfaacf9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKqeElhZ {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKqeElhZ" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8f0da-3ee4-4419-b787-f576c685abac]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKqeElhZ'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[212fa4f0-818b-4ee1-9bff-ddfc795a90bd]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece830d7-24ba-4111-a338-c7173e8ca149]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b411d931-40b7-4157-b1f8-d61e148c5dcb (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b411d931-40b7-4157-b1f8-d61e148c5dcb (non-flash)
Oct 25 16:50:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b411d931-40b7-4157-b1f8-d61e148c5dcb (non-flash)
Oct 25 16:50:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822917c-4535-45c6-a33b-f686db92ff5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260]
Oct 25 16:50:38 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260] successful.
Oct 25 16:50:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7f4f1-995f-42a6-9a57-afbcd727d4a6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[661f87a4-6354-4136-ab22-b15870b29209]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b411d931-40b7-4157-b1f8-d61e148c5dcb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b411d931-40b7-4157-b1f8-d61e148c5dcb (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b411d931-40b7-4157-b1f8-d61e148c5dcb (non-flash)
Oct 25 16:50:38 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec0a51-1bba-4282-9f63-0bd5ab07160f]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:50:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKqeElhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:50:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:50:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23961653062353335', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:50:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961653062353335', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:50:39 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'flavor' on Instance uuid 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:50:39 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:50:39 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:50:39 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:50:39 user nova-compute[74048]:   <serial>7defa66c-f0d6-4c6f-acf8-f370ee30823b</serial>
Oct 25 16:50:39 user nova-compute[74048]: </disk>
Oct 25 16:50:39 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:50:40 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:50:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:50:40 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No VIF found with MAC fa:16:3e:5e:10:02, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:50:40 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5fc63d46-01f3-4bc4-8262-98d526a1ee6b tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.967s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:42 user nova-compute[74048]: INFO nova.compute.manager [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Detaching volume 7defa66c-f0d6-4c6f-acf8-f370ee30823b
Oct 25 16:50:42 user nova-compute[74048]: INFO nova.virt.block_device [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Attempting to driver detach volume 7defa66c-f0d6-4c6f-acf8-f370ee30823b from mountpoint /dev/vdb
Oct 25 16:50:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Attempting to detach device vdb from instance 35db9646-f68d-4180-94cd-9cce20c0756f from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:50:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:50:42 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:50:42 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:50:42 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:50:42 user nova-compute[74048]:   <serial>7defa66c-f0d6-4c6f-acf8-f370ee30823b</serial>
Oct 25 16:50:42 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:50:42 user nova-compute[74048]: </disk>
Oct 25 16:50:42 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:50:42 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully detached device vdb from instance 35db9646-f68d-4180-94cd-9cce20c0756f from the persistent domain config.
Oct 25 16:50:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35db9646-f68d-4180-94cd-9cce20c0756f from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:50:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:50:42 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:50:42 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:50:42 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:50:42 user nova-compute[74048]:   <serial>7defa66c-f0d6-4c6f-acf8-f370ee30823b</serial>
Oct 25 16:50:42 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:50:42 user nova-compute[74048]: </disk>
Oct 25 16:50:42 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:50:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:50:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "e504822c-ad65-4758-983c-5793fcad61fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "e504822c-ad65-4758-983c-5793fcad61fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:50:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:49 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:50:49 user nova-compute[74048]: INFO nova.compute.claims [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Claim successful on node user
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:50:50 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:50:50 user nova-compute[74048]: INFO nova.virt.block_device [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Booting with volume 4f1a8b34-0402-46d3-a2bb-08c19f92c710 at /dev/vda
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.policy [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef034e25bba42e78a18c07c4e7ec3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2facb7bd1f4b47149df26f9494f180ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG os_brick.utils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d6366a-a89f-4187-b87e-74b4160df870]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[14431f5b-652d-48e9-a468-490477c4f095]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd83b0-b3fe-4860-a872-954198ff1d69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[634fc90a-d5d0-418f-be1d-c9989dfeb9f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:50:50 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ee944-36f7-421f-beb8-d8ea24bea363]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG os_brick.utils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Updating existing volume attachment record: c7f617f6-e05d-49ff-871c-3c7e9572fa92 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'info_cache' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:50 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Successfully created port: a76b65e0-a6d5-4832-875b-00633c72de17 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:50:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance destroyed successfully.
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'resources' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3c8049b-bd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29eb8831-b64b-4709-9d0e-db8176498725) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:51 user nova-compute[74048]: INFO os_vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd')
Oct 25 16:50:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:50:51 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398cf5d-9e2e-4685-aecc-477886c02e45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:50:51 user nova-compute[74048]: No targets found.
Oct 25 16:50:51 user nova-compute[74048]: iSNS:
Oct 25 16:50:51 user nova-compute[74048]: No targets found.
Oct 25 16:50:51 user nova-compute[74048]: STATIC:
Oct 25 16:50:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:50:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:50:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:50:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b
Oct 25 16:50:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:50:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:50:51 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:50:51 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:50:51 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:50:51 user nova-compute[74048]: FIRMWARE:
Oct 25 16:50:51 user nova-compute[74048]: No targets found.
Oct 25 16:50:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:50:51 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:50:51 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c967a-e103-45fe-a86f-a79b52740588]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f8c77-659a-4445-8b8f-7347cffcc673]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:51 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:51 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:51 user nova-compute[74048]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:51 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:51 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184053d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45'): ({'sde'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Removing single pathed devices sde {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d22792-d1d3-4546-b1e4-a6a24bf3121f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fcca69-9284-4251-8d0a-c99e974eb763]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flushing IO for device /dev/sde {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1314ad-95b1-4ce1-b8ee-9e3250d4de81]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ac12b-95ea-47cc-bf62-fa4a8584563e]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] SCSI volumes sde have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[279137a3-5a83-4e65-ab52-cfd368adb75b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be93009-ebe1-479e-abf2-574de079f670]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]
Oct 25 16:50:52 user nova-compute[74048]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb4da4-5348-4f97-aec8-133db2839ead]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== disconnect_volume: return (335ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start _get_guest_xml network_info=[{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '200a4d07-04e6-49f2-964e-854f79b0a855', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '063fb985-6780-4196-90b6-dc92ab263244', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'serial': 'fbaabef9-6d7f-44d5-87b8-a2690e072b45'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'numa_topology' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:52 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:50:52 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'vcpu_model' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:50:52 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:50:52 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:50:52 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc6675-9038-47c2-a287-4b70bf38451d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:50:52 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8e124-d020-4cc1-956d-1e5d7f92a801]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45] added
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00b6056-fda5-452a-873c-6cf2af2cb202]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc36ca8-9864-4dc4-82fb-a94e92453295]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWHvraNX {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWHvraNX" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe2129a-683c-4aee-b827-4950bb85b813]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OWHvraNX'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1e637-087f-4dd1-9f36-a900ea48bc4a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c3d62-fcac-4cf6-a1e8-641f59c68837]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:52 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:52 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d1b20-f0a9-48ea-bbc6-2fe0398682b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]
Oct 25 16:50:52 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[886391a5-786b-4172-bd9a-013efd3555fe]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c8e630-17bc-4b55-968e-0bc5bc45c103]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:52 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:52 user nova-compute[74048]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:50:52 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:50:52 user nova-compute[74048]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:50:52 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec0bf7f-c3cf-460d-af8c-15451263a9be]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Successfully updated port: a76b65e0-a6d5-4832-875b-00633c72de17 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "refresh_cache-e504822c-ad65-4758-983c-5793fcad61fc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquired lock "refresh_cache-e504822c-ad65-4758-983c-5793fcad61fc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Received event network-changed-a76b65e0-a6d5-4832-875b-00633c72de17 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Refreshing instance network info cache due to event network-changed-a76b65e0-a6d5-4832-875b-00633c72de17. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] Acquiring lock "refresh_cache-e504822c-ad65-4758-983c-5793fcad61fc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Updating instance_info_cache with network_info: [{"id": "a76b65e0-a6d5-4832-875b-00633c72de17", "address": "fa:16:3e:80:25:db", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa76b65e0-a6", "ovs_interfaceid": "a76b65e0-a6d5-4832-875b-00633c72de17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Releasing lock "refresh_cache-e504822c-ad65-4758-983c-5793fcad61fc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Instance network_info: |[{"id": "a76b65e0-a6d5-4832-875b-00633c72de17", "address": "fa:16:3e:80:25:db", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa76b65e0-a6", "ovs_interfaceid": "a76b65e0-a6d5-4832-875b-00633c72de17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] Acquired lock "refresh_cache-e504822c-ad65-4758-983c-5793fcad61fc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.network.neutron [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Refreshing network info cache for port a76b65e0-a6d5-4832-875b-00633c72de17 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:50:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Updated VIF entry in instance network info cache for port a76b65e0-a6d5-4832-875b-00633c72de17. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.network.neutron [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Updating instance_info_cache with network_info: [{"id": "a76b65e0-a6d5-4832-875b-00633c72de17", "address": "fa:16:3e:80:25:db", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa76b65e0-a6", "ovs_interfaceid": "a76b65e0-a6d5-4832-875b-00633c72de17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2212a9c5-c0c7-4cea-9596-fc2ceff2df91 req-5aadca51-34c3-42a1-bf5a-2de31d8d8c70 service nova] Releasing lock "refresh_cache-e504822c-ad65-4758-983c-5793fcad61fc" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23732366466643639', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732366466643639', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'pci_devices' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:50:53 user nova-compute[74048]:   <uuid>063fb985-6780-4196-90b6-dc92ab263244</uuid>
Oct 25 16:50:53 user nova-compute[74048]:   <name>instance-00000026</name>
Oct 25 16:50:53 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:50:53 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:50:53 user nova-compute[74048]:   <metadata>
Oct 25 16:50:53 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:50:53 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:50:53 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeTestJSON-server-789838502</nova:name>
Oct 25 16:50:53 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:50:52</nova:creationTime>
Oct 25 16:50:53 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:50:53 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:50:53 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:50:53 user nova-compute[74048]:       <nova:owner>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:user uuid="5010a1f24ffe411f849b0917ee40d17b">tempest-AttachVolumeTestJSON-251204741-project-member</nova:user>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:project uuid="4a9cc47d22fc44f9babc2ec69f539e77">tempest-AttachVolumeTestJSON-251204741</nova:project>
Oct 25 16:50:53 user nova-compute[74048]:       </nova:owner>
Oct 25 16:50:53 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:50:53 user nova-compute[74048]:       <nova:ports>
Oct 25 16:50:53 user nova-compute[74048]:         <nova:port uuid="d3c8049b-bdc5-494f-aa5f-036fb3218564">
Oct 25 16:50:53 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:50:53 user nova-compute[74048]:         </nova:port>
Oct 25 16:50:53 user nova-compute[74048]:       </nova:ports>
Oct 25 16:50:53 user nova-compute[74048]:     </nova:instance>
Oct 25 16:50:53 user nova-compute[74048]:   </metadata>
Oct 25 16:50:53 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:50:53 user nova-compute[74048]:     <system>
Oct 25 16:50:53 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:50:53 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:50:53 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:50:53 user nova-compute[74048]:       <entry name="serial">063fb985-6780-4196-90b6-dc92ab263244</entry>
Oct 25 16:50:53 user nova-compute[74048]:       <entry name="uuid">063fb985-6780-4196-90b6-dc92ab263244</entry>
Oct 25 16:50:53 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:50:53 user nova-compute[74048]:     </system>
Oct 25 16:50:53 user nova-compute[74048]:   </sysinfo>
Oct 25 16:50:53 user nova-compute[74048]:   <os>
Oct 25 16:50:53 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:50:53 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:50:53 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:50:53 user nova-compute[74048]:   </os>
Oct 25 16:50:53 user nova-compute[74048]:   <features>
Oct 25 16:50:53 user nova-compute[74048]:     <acpi/>
Oct 25 16:50:53 user nova-compute[74048]:     <apic/>
Oct 25 16:50:53 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:50:53 user nova-compute[74048]:   </features>
Oct 25 16:50:53 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:50:53 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:50:53 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:50:53 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:50:53 user nova-compute[74048]:   </clock>
Oct 25 16:50:53 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:50:53 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:50:53 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:50:53 user nova-compute[74048]:   </cpu>
Oct 25 16:50:53 user nova-compute[74048]:   <devices>
Oct 25 16:50:53 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:50:53 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:50:53 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk"/>
Oct 25 16:50:53 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:50:53 user nova-compute[74048]:     </disk>
Oct 25 16:50:53 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:50:53 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:50:53 user nova-compute[74048]:       <source dev="/dev/sdb"/>
Oct 25 16:50:53 user nova-compute[74048]:       <target dev="vdb" bus="virtio"/>
Oct 25 16:50:53 user nova-compute[74048]:       <serial>fbaabef9-6d7f-44d5-87b8-a2690e072b45</serial>
Oct 25 16:50:53 user nova-compute[74048]:     </disk>
Oct 25 16:50:53 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:50:53 user nova-compute[74048]:       <mac address="fa:16:3e:54:94:ad"/>
Oct 25 16:50:53 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:50:53 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:50:53 user nova-compute[74048]:       <target dev="tapd3c8049b-bd"/>
Oct 25 16:50:53 user nova-compute[74048]:     </interface>
Oct 25 16:50:53 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:50:53 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/console.log" append="off"/>
Oct 25 16:50:53 user nova-compute[74048]:     </serial>
Oct 25 16:50:53 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:50:53 user nova-compute[74048]:     <video>
Oct 25 16:50:53 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:50:53 user nova-compute[74048]:     </video>
Oct 25 16:50:53 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:50:53 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:50:53 user nova-compute[74048]:     </rng>
Oct 25 16:50:53 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:50:53 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:50:53 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:50:53 user nova-compute[74048]:     </memballoon>
Oct 25 16:50:53 user nova-compute[74048]:   </devices>
Oct 25 16:50:53 user nova-compute[74048]: </domain>
Oct 25 16:50:53 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'trusted_certs' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Cannot resize image /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'migration_context' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.objects.base [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG os_vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec594c7c-16f3-5ad1-beea-db9f60578006', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3c8049b-bd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3c8049b-bd, col_values=(('qos', UUID('078f7c3c-e72c-4d7d-b100-56aebcac8bcb')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3c8049b-bd, col_values=(('external_ids', {'iface-id': 'd3c8049b-bdc5-494f-aa5f-036fb3218564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:94:ad', 'vm-uuid': '063fb985-6780-4196-90b6-dc92ab263244'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:50:54 user nova-compute[74048]: INFO os_vif [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd')
Oct 25 16:50:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-85feafa3-1cc0-485d-8509-f575f0f8d592 req-f36ae671-8586-4182-bc52-c6a6495e00f7 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-85feafa3-1cc0-485d-8509-f575f0f8d592 req-f36ae671-8586-4182-bc52-c6a6495e00f7 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-85feafa3-1cc0-485d-8509-f575f0f8d592 req-f36ae671-8586-4182-bc52-c6a6495e00f7 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-85feafa3-1cc0-485d-8509-f575f0f8d592 req-f36ae671-8586-4182-bc52-c6a6495e00f7 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-85feafa3-1cc0-485d-8509-f575f0f8d592 req-f36ae671-8586-4182-bc52-c6a6495e00f7 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:50:56 user nova-compute[74048]: WARNING nova.compute.manager [req-85feafa3-1cc0-485d-8509-f575f0f8d592 req-f36ae671-8586-4182-bc52-c6a6495e00f7 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state stopped and task_state powering-on.
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:50:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance rebooted successfully.
Oct 25 16:50:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-4fbd41e3-201e-4e92-809c-3e28a971942c tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-389f3ca1-b173-4e0a-bc1a-88c552edd32b req-fe05977b-3d94-4a0d-aa22-f63bddff7af8 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-389f3ca1-b173-4e0a-bc1a-88c552edd32b req-fe05977b-3d94-4a0d-aa22-f63bddff7af8 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-389f3ca1-b173-4e0a-bc1a-88c552edd32b req-fe05977b-3d94-4a0d-aa22-f63bddff7af8 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-389f3ca1-b173-4e0a-bc1a-88c552edd32b req-fe05977b-3d94-4a0d-aa22-f63bddff7af8 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-389f3ca1-b173-4e0a-bc1a-88c552edd32b req-fe05977b-3d94-4a0d-aa22-f63bddff7af8 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:50:58 user nova-compute[74048]: WARNING nova.compute.manager [req-389f3ca1-b173-4e0a-bc1a-88c552edd32b req-fe05977b-3d94-4a0d-aa22-f63bddff7af8 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state active and task_state None.
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:50:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:50:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:50:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8270MB free_disk=24.957263946533203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance b5e77341-b320-41e8-aa75-f74052b893cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance e504822c-ad65-4758-983c-5793fcad61fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:50:59 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:51:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:51:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:51:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:51:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:51:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:03 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35db9646-f68d-4180-94cd-9cce20c0756f is timed out.
Oct 25 16:51:03 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully detached device vdb from instance 35db9646-f68d-4180-94cd-9cce20c0756f from the live domain config.
Oct 25 16:51:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKqeElhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:51:03 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b167f5b-2adb-4544-bf1e-e01de54a2f08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:51:03 user nova-compute[74048]: No targets found.
Oct 25 16:51:03 user nova-compute[74048]: iSNS:
Oct 25 16:51:03 user nova-compute[74048]: No targets found.
Oct 25 16:51:03 user nova-compute[74048]: STATIC:
Oct 25 16:51:03 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:51:03 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:51:03 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:51:03 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b
Oct 25 16:51:03 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:51:03 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:51:03 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:51:03 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:51:03 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:51:03 user nova-compute[74048]: FIRMWARE:
Oct 25 16:51:03 user nova-compute[74048]: No targets found.
Oct 25 16:51:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:51:03 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:51:03 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8544a4fa-df1c-4391-b019-725916b90999]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86c09b-f372-499a-9903-c34237436564]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:51:03 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:51:03 user nova-compute[74048]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:51:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:51:03 user nova-compute[74048]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b (non-flash)
Oct 25 16:51:03 user nova-compute[74048]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:51:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840585090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdfc367-d01c-4596-9398-5e64556de92a]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b902735f-907c-410b-9af4-a60d257c9b7c]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d529eb9-7f0d-45bc-872b-e9b39d1aaaca]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e43b6-be7b-4a27-a80c-0acb435fbddd]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabb69e6-1f3c-4794-a83b-438c434f4095]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6a397d-66db-4874-9e8a-fcb4f624fd82]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260]
Oct 25 16:51:03 user nova-compute[74048]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b, portal: 172.16.0.220,3260] successful.
Oct 25 16:51:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7defa66c-f0d6-4c6f-acf8-f370ee30823b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0347034-c505-46e4-92f6-5125e0546405]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] <== disconnect_volume: return (371ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:51:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:51:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:04 user nova-compute[74048]: DEBUG nova.objects.instance [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'flavor' on Instance uuid 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:51:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-04b01b5d-d952-4e1f-8e04-eb7d27cc9af3 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.volume.cinder [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Update attachment failed for attachment c7f617f6-e05d-49ff-871c-3c7e9572fa92. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc] Traceback (most recent call last):
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     driver_block_device.attach_block_devices(
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     _log_and_attach(device)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     bdm.attach(*attach_args, **attach_kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     self._do_attach(context, instance, volume, volume_api,
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     self._volume_attach(context, volume, connector, instance,
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     connection_info = volume_api.attachment_update(
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     res = method(self, ctx, *args, **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     with excutils.save_and_reraise_exception():
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     self.force_reraise()
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     raise self.value
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     return method.func(obj, *args, **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     resp = self._update('/attachments/%s' % id, body)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     return self.request(url, method, **kwargs)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc]     raise exceptions.from_response(resp, body)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4)
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [instance: e504822c-ad65-4758-983c-5793fcad61fc] 
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.claims [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Aborting claim: <nova.compute.claims.Claim object at 0x7f1858077a30> {{(pid=74048) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.441s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Build of instance e504822c-ad65-4758-983c-5793fcad61fc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4) {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.utils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Build of instance e504822c-ad65-4758-983c-5793fcad61fc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74048) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 25 16:51:06 user nova-compute[74048]: ERROR nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Build of instance e504822c-ad65-4758-983c-5793fcad61fc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4): nova.exception.BuildAbortException: Build of instance e504822c-ad65-4758-983c-5793fcad61fc aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb3aa617-68fb-4ffb-b273-56e80a5354d4)
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Unplugging VIFs for instance {{(pid=74048) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1309379793',display_name='tempest-TestVolumeBootPattern-server-1309379793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1309379793',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRroVIW4WP8QnZX93hbfJbQq4qAfVxIKH1BVKna5piUodooD3O41S1ik3wovQBHlJN61YMN2ccM3pXh7C+WYFvT7OiYwbcLCij1eRkVnAPyk5cD+ZHqCsh2yaLRftFFHA==',key_name='tempest-TestVolumeBootPattern-749435674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2facb7bd1f4b47149df26f9494f180ae',ramdisk_id='',reservation_id='r-1l5athu5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1454543820',owner_user_name='tempest-TestVolumeBootPattern-1454543820-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:50:50Z,user_data=None,user_id='0ef034e25bba42e78a18c07c4e7ec3b2',uuid=e504822c-ad65-4758-983c-5793fcad61fc,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a76b65e0-a6d5-4832-875b-00633c72de17", "address": "fa:16:3e:80:25:db", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa76b65e0-a6", "ovs_interfaceid": "a76b65e0-a6d5-4832-875b-00633c72de17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converting VIF {"id": "a76b65e0-a6d5-4832-875b-00633c72de17", "address": "fa:16:3e:80:25:db", "network": {"id": "59a40560-0588-442a-9542-89a1d7b6d0b3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1573418687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2facb7bd1f4b47149df26f9494f180ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa76b65e0-a6", "ovs_interfaceid": "a76b65e0-a6d5-4832-875b-00633c72de17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:25:db,bridge_name='br-int',has_traffic_filtering=True,id=a76b65e0-a6d5-4832-875b-00633c72de17,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa76b65e0-a6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG os_vif [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:25:db,bridge_name='br-int',has_traffic_filtering=True,id=a76b65e0-a6d5-4832-875b-00633c72de17,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa76b65e0-a6') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa76b65e0-a6, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:51:06 user nova-compute[74048]: INFO os_vif [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:25:db,bridge_name='br-int',has_traffic_filtering=True,id=a76b65e0-a6d5-4832-875b-00633c72de17,network=Network(59a40560-0588-442a-9542-89a1d7b6d0b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa76b65e0-a6')
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Unplugged VIFs for instance {{(pid=74048) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:51:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:51:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:51:07 user nova-compute[74048]: INFO nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Took 0.55 seconds to deallocate network for instance.
Oct 25 16:51:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Detaching volume: 4f1a8b34-0402-46d3-a2bb-08c19f92c710 {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 25 16:51:07 user nova-compute[74048]: INFO nova.compute.manager [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Detaching volume 4f1a8b34-0402-46d3-a2bb-08c19f92c710
Oct 25 16:51:07 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] [instance: e504822c-ad65-4758-983c-5793fcad61fc] Skipping driver_detach during remote rebuild. {{(pid=74048) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 25 16:51:07 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Deleted allocations for instance e504822c-ad65-4758-983c-5793fcad61fc
Oct 25 16:51:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b22231a8-7a9e-4020-a469-f1b8b998070a tempest-TestVolumeBootPattern-1454543820 tempest-TestVolumeBootPattern-1454543820-project-member] Lock "e504822c-ad65-4758-983c-5793fcad61fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.129s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid d587e48c-2104-4f0b-a12c-7334a63d3d5f {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid b5e77341-b320-41e8-aa75-f74052b893cb {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "54b28e3c-f604-4d30-ac14-805da155813d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "b5e77341-b320-41e8-aa75-f74052b893cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "b5e77341-b320-41e8-aa75-f74052b893cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "54b28e3c-f604-4d30-ac14-805da155813d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:16 user nova-compute[74048]: INFO nova.compute.manager [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Terminating instance
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "b5e77341-b320-41e8-aa75-f74052b893cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:16 user nova-compute[74048]: INFO nova.compute.manager [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Terminating instance
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-c1ffb053-9169-4ded-bac9-5c36d5c981aa req-0f28edbd-03a2-4caf-b52c-68a18d5a48db service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-unplugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c1ffb053-9169-4ded-bac9-5c36d5c981aa req-0f28edbd-03a2-4caf-b52c-68a18d5a48db service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c1ffb053-9169-4ded-bac9-5c36d5c981aa req-0f28edbd-03a2-4caf-b52c-68a18d5a48db service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c1ffb053-9169-4ded-bac9-5c36d5c981aa req-0f28edbd-03a2-4caf-b52c-68a18d5a48db service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-c1ffb053-9169-4ded-bac9-5c36d5c981aa req-0f28edbd-03a2-4caf-b52c-68a18d5a48db service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-unplugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-c1ffb053-9169-4ded-bac9-5c36d5c981aa req-0f28edbd-03a2-4caf-b52c-68a18d5a48db service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-unplugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-7db79af5-a2bf-4c2b-b016-f7d467da4cd9 req-1375e2d2-01b6-4032-b207-659a64fb1048 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-vif-unplugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7db79af5-a2bf-4c2b-b016-f7d467da4cd9 req-1375e2d2-01b6-4032-b207-659a64fb1048 service nova] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7db79af5-a2bf-4c2b-b016-f7d467da4cd9 req-1375e2d2-01b6-4032-b207-659a64fb1048 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7db79af5-a2bf-4c2b-b016-f7d467da4cd9 req-1375e2d2-01b6-4032-b207-659a64fb1048 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-7db79af5-a2bf-4c2b-b016-f7d467da4cd9 req-1375e2d2-01b6-4032-b207-659a64fb1048 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] No waiting events found dispatching network-vif-unplugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG nova.compute.manager [req-7db79af5-a2bf-4c2b-b016-f7d467da4cd9 req-1375e2d2-01b6-4032-b207-659a64fb1048 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-vif-unplugged-38554701-fd40-43e2-94e4-42839020572c for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Instance destroyed successfully.
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lazy-loading 'resources' on Instance uuid 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Instance destroyed successfully.
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.objects.instance [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'resources' on Instance uuid b5e77341-b320-41e8-aa75-f74052b893cb {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1387765298',display_name='tempest-ServersNegativeTestJSON-server-1387765298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1387765298',id=33,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd43437268443f5aa648d69dc0ad17c',ramdisk_id='',reservation_id='r-5z74mz8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2069803193',owner_user_name='tempest-ServersNegativeTestJSON-2069803193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:42:18Z,user_data=None,user_id='df5f905d61744496bfafcdfd3f500896',uuid=9bb79d7a-8a82-4ce8-912e-7f28bf8deebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converting VIF {"id": "ce511ca1-0e95-4ce5-858c-845276995a73", "address": "fa:16:3e:d5:e1:75", "network": {"id": "91c1d9a8-5a52-4353-902d-68eaeff859d4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047150826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd43437268443f5aa648d69dc0ad17c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce511ca1-0e", "ovs_interfaceid": "ce511ca1-0e95-4ce5-858c-845276995a73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG os_vif [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce511ca1-0e, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1212154774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1212154774',id=30,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:41:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-e3zwtwci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:43:00Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=b5e77341-b320-41e8-aa75-f74052b893cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "38554701-fd40-43e2-94e4-42839020572c", "address": "fa:16:3e:57:2f:6a", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38554701-fd", "ovs_interfaceid": "38554701-fd40-43e2-94e4-42839020572c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG os_vif [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38554701-fd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e966e275-27d0-48f4-aa94-d64844ee8fb5) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b57f3def-4056-4148-a6d9-893c718258b4) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:17 user nova-compute[74048]: INFO os_vif [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:e1:75,bridge_name='br-int',has_traffic_filtering=True,id=ce511ca1-0e95-4ce5-858c-845276995a73,network=Network(91c1d9a8-5a52-4353-902d-68eaeff859d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce511ca1-0e')
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Deleting instance files /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf_del
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Deletion of /opt/stack/data/nova/instances/9bb79d7a-8a82-4ce8-912e-7f28bf8deebf_del complete
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:51:17 user nova-compute[74048]: INFO os_vif [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:2f:6a,bridge_name='br-int',has_traffic_filtering=True,id=38554701-fd40-43e2-94e4-42839020572c,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38554701-fd')
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Deleting instance files /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb_del
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Deletion of /opt/stack/data/nova/instances/b5e77341-b320-41e8-aa75-f74052b893cb_del complete
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.compute.manager [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 25 16:51:17 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:51:17 user nova-compute[74048]: INFO nova.compute.manager [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 25 16:51:17 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:51:18 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Took 0.93 seconds to deallocate network for instance.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fd3e6541-7d89-430c-a034-3d13fe9a0b69 req-93e66e88-8dad-4924-9cef-12703cc95ec6 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-deleted-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:51:18 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Took 1.03 seconds to deallocate network for instance.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:18 user nova-compute[74048]: WARNING nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state deleted and task_state None.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:18 user nova-compute[74048]: WARNING nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state deleted and task_state None.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:18 user nova-compute[74048]: WARNING nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state deleted and task_state None.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-unplugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-unplugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:18 user nova-compute[74048]: WARNING nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-unplugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state deleted and task_state None.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Acquiring lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] No waiting events found dispatching network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:18 user nova-compute[74048]: WARNING nova.compute.manager [req-fc9a1243-dc60-4757-bc9b-b85928a5e1a1 req-089b4db2-3a5c-48af-bc2e-ef6162631d10 service nova] [instance: 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf] Received unexpected event network-vif-plugged-ce511ca1-0e95-4ce5-858c-845276995a73 for instance with vm_state deleted and task_state None.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.191s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Deleted allocations for instance 9bb79d7a-8a82-4ce8-912e-7f28bf8deebf
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4054ff0-9469-4a87-b615-10bd5039fb40 req-7ccc2419-e1ab-4209-8a31-f02e40e92dd8 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4054ff0-9469-4a87-b615-10bd5039fb40 req-7ccc2419-e1ab-4209-8a31-f02e40e92dd8 service nova] Acquiring lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4054ff0-9469-4a87-b615-10bd5039fb40 req-7ccc2419-e1ab-4209-8a31-f02e40e92dd8 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4054ff0-9469-4a87-b615-10bd5039fb40 req-7ccc2419-e1ab-4209-8a31-f02e40e92dd8 service nova] Lock "b5e77341-b320-41e8-aa75-f74052b893cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4054ff0-9469-4a87-b615-10bd5039fb40 req-7ccc2419-e1ab-4209-8a31-f02e40e92dd8 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] No waiting events found dispatching network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:18 user nova-compute[74048]: WARNING nova.compute.manager [req-f4054ff0-9469-4a87-b615-10bd5039fb40 req-7ccc2419-e1ab-4209-8a31-f02e40e92dd8 service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received unexpected event network-vif-plugged-38554701-fd40-43e2-94e4-42839020572c for instance with vm_state deleted and task_state None.
Oct 25 16:51:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f25a0379-558e-4985-a086-0aee4f696980 tempest-ServersNegativeTestJSON-2069803193 tempest-ServersNegativeTestJSON-2069803193-project-member] Lock "9bb79d7a-8a82-4ce8-912e-7f28bf8deebf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:51:18 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:51:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:19 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Deleted allocations for instance b5e77341-b320-41e8-aa75-f74052b893cb
Oct 25 16:51:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-43866464-67cb-48d5-9b48-860bab7c2f1b tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "b5e77341-b320-41e8-aa75-f74052b893cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-f222f95c-4dbe-497c-aac1-ad38b510ae1e req-1dab78cc-9987-40fa-ac35-25926cd4e49d service nova] [instance: b5e77341-b320-41e8-aa75-f74052b893cb] Received event network-vif-deleted-38554701-fd40-43e2-94e4-42839020572c {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:51:43 user nova-compute[74048]: INFO nova.compute.manager [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] instance snapshotting
Oct 25 16:51:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Beginning live snapshot process
Oct 25 16:51:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json -f qcow2 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphec5ycbp/d651e0d6ccae43bdabb5703a3509f215.delta 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphec5ycbp/d651e0d6ccae43bdabb5703a3509f215.delta 1073741824" returned: 0 in 0.054s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 16:51:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:51:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74048) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 16:51:45 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 16:51:45 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:51:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphec5ycbp/d651e0d6ccae43bdabb5703a3509f215.delta /opt/stack/data/nova/instances/snapshots/tmphec5ycbp/d651e0d6ccae43bdabb5703a3509f215 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphec5ycbp/d651e0d6ccae43bdabb5703a3509f215.delta /opt/stack/data/nova/instances/snapshots/tmphec5ycbp/d651e0d6ccae43bdabb5703a3509f215" returned: 0 in 0.844s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Snapshot extracted, beginning image upload
Oct 25 16:51:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:51:49 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Snapshot image upload complete
Oct 25 16:51:49 user nova-compute[74048]: INFO nova.compute.manager [None req-20323aa7-6b4b-44df-9652-fc0f97aedd5c tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Took 5.97 seconds to snapshot the instance on the hypervisor.
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:51:51 user nova-compute[74048]: INFO nova.compute.claims [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Claim successful on node user
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:51:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.policy [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebdff923d6304b37880ae8bd217f2f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8acd0141444fa2ae4dd9f49267715a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:51:51 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Creating image(s)
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "/opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "/opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "/opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:52 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.part --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Successfully created port: 7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:51:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.part --force-share --output=json" returned: 0 in 0.233s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG nova.virt.images [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] 21439d94-30f7-4f94-9eba-3e1a11063533 was qcow2, converting to raw {{(pid=74048) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG nova.privsep.utils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74048) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.part /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.converted {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.part /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.converted" returned: 0 in 0.266s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.converted --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.741s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Successfully updated port: 7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquired lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-changed-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.compute.manager [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Refreshing instance network info cache due to event network-changed-7320273c-b4ff-4c16-bf72-c01547e92972. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] Acquiring lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa,backing_fmt=raw /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa,backing_fmt=raw /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk 1073741824" returned: 0 in 0.052s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.neutron [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating instance_info_cache with network_info: [{"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Releasing lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Instance network_info: |[{"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] Acquired lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Refreshing network info cache for port 7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Ensure instance console log exists: /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Start _get_guest_xml network_info=[{"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='edfd6479fef9b4c8e5518de2541829ff',container_format='bare',created_at=2023-10-25T16:51:43Z,direct_url=<?>,disk_format='qcow2',id=21439d94-30f7-4f94-9eba-3e1a11063533,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1052562084',owner='8e8acd0141444fa2ae4dd9f49267715a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T16:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '21439d94-30f7-4f94-9eba-3e1a11063533'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:51:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:51:54 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='edfd6479fef9b4c8e5518de2541829ff',container_format='bare',created_at=2023-10-25T16:51:43Z,direct_url=<?>,disk_format='qcow2',id=21439d94-30f7-4f94-9eba-3e1a11063533,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1052562084',owner='8e8acd0141444fa2ae4dd9f49267715a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T16:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1249359891',display_name='tempest-TestStampPattern-server-1249359891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1249359891',id=43,image_ref='21439d94-30f7-4f94-9eba-3e1a11063533',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY/XNxT3bZdfbS7bA8TEGYcJcrnDZXILC+YdYHyiQNZqB7M8VNeazxYLUF69qWftbyUFlAVIUHgkPt223heRLbEHqBn6l2ugX2Ts6mv/TBI7i/pV0nvB9213qET7Ai/mA==',key_name='tempest-TestStampPattern-1069318120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e8acd0141444fa2ae4dd9f49267715a',ramdisk_id='',reservation_id='r-r6w4aiv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='35db9646-f68d-4180-94cd-9cce20c0756f',image_min_disk='1',image_min_ram='0',image_owner_id='8e8acd0141444fa2ae4dd9f49267715a',image_owner_project_name='tempest-TestStampPattern-1148836256',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1148836256-project-member',image_user_id='ebdff923d6304b37880ae8bd217f2f3a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1148836256',owner_user_name='tempest-TestStampPattern-1148836256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:51:52Z,user_data=None,user_id='ebdff923d6304b37880ae8bd217f2f3a',uuid=79b0e968-4730-4abd-b252-3f7d140b18d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converting VIF {"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b0e968-4730-4abd-b252-3f7d140b18d1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:51:54 user nova-compute[74048]:   <uuid>79b0e968-4730-4abd-b252-3f7d140b18d1</uuid>
Oct 25 16:51:54 user nova-compute[74048]:   <name>instance-0000002b</name>
Oct 25 16:51:54 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:51:54 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:51:54 user nova-compute[74048]:   <metadata>
Oct 25 16:51:54 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:51:54 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:51:54 user nova-compute[74048]:       <nova:name>tempest-TestStampPattern-server-1249359891</nova:name>
Oct 25 16:51:54 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:51:54</nova:creationTime>
Oct 25 16:51:54 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:51:54 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:51:54 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:51:54 user nova-compute[74048]:       <nova:owner>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:user uuid="ebdff923d6304b37880ae8bd217f2f3a">tempest-TestStampPattern-1148836256-project-member</nova:user>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:project uuid="8e8acd0141444fa2ae4dd9f49267715a">tempest-TestStampPattern-1148836256</nova:project>
Oct 25 16:51:54 user nova-compute[74048]:       </nova:owner>
Oct 25 16:51:54 user nova-compute[74048]:       <nova:root type="image" uuid="21439d94-30f7-4f94-9eba-3e1a11063533"/>
Oct 25 16:51:54 user nova-compute[74048]:       <nova:ports>
Oct 25 16:51:54 user nova-compute[74048]:         <nova:port uuid="7320273c-b4ff-4c16-bf72-c01547e92972">
Oct 25 16:51:54 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 16:51:54 user nova-compute[74048]:         </nova:port>
Oct 25 16:51:54 user nova-compute[74048]:       </nova:ports>
Oct 25 16:51:54 user nova-compute[74048]:     </nova:instance>
Oct 25 16:51:54 user nova-compute[74048]:   </metadata>
Oct 25 16:51:54 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:51:54 user nova-compute[74048]:     <system>
Oct 25 16:51:54 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:51:54 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:51:54 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:51:54 user nova-compute[74048]:       <entry name="serial">79b0e968-4730-4abd-b252-3f7d140b18d1</entry>
Oct 25 16:51:54 user nova-compute[74048]:       <entry name="uuid">79b0e968-4730-4abd-b252-3f7d140b18d1</entry>
Oct 25 16:51:54 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:51:54 user nova-compute[74048]:     </system>
Oct 25 16:51:54 user nova-compute[74048]:   </sysinfo>
Oct 25 16:51:54 user nova-compute[74048]:   <os>
Oct 25 16:51:54 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:51:54 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:51:54 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:51:54 user nova-compute[74048]:   </os>
Oct 25 16:51:54 user nova-compute[74048]:   <features>
Oct 25 16:51:54 user nova-compute[74048]:     <acpi/>
Oct 25 16:51:54 user nova-compute[74048]:     <apic/>
Oct 25 16:51:54 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:51:54 user nova-compute[74048]:   </features>
Oct 25 16:51:54 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:51:54 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:51:54 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:51:54 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:51:54 user nova-compute[74048]:   </clock>
Oct 25 16:51:54 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:51:54 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:51:54 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:51:54 user nova-compute[74048]:   </cpu>
Oct 25 16:51:54 user nova-compute[74048]:   <devices>
Oct 25 16:51:54 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:51:54 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:51:54 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk"/>
Oct 25 16:51:54 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:51:54 user nova-compute[74048]:     </disk>
Oct 25 16:51:54 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:51:54 user nova-compute[74048]:       <mac address="fa:16:3e:c2:47:d6"/>
Oct 25 16:51:54 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:51:54 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:51:54 user nova-compute[74048]:       <target dev="tap7320273c-b4"/>
Oct 25 16:51:54 user nova-compute[74048]:     </interface>
Oct 25 16:51:54 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:51:54 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/console.log" append="off"/>
Oct 25 16:51:54 user nova-compute[74048]:     </serial>
Oct 25 16:51:54 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:51:54 user nova-compute[74048]:     <video>
Oct 25 16:51:54 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:51:54 user nova-compute[74048]:     </video>
Oct 25 16:51:54 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:51:54 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:51:54 user nova-compute[74048]:     </rng>
Oct 25 16:51:54 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:51:54 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:51:54 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:51:54 user nova-compute[74048]:     </memballoon>
Oct 25 16:51:54 user nova-compute[74048]:   </devices>
Oct 25 16:51:54 user nova-compute[74048]: </domain>
Oct 25 16:51:54 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1249359891',display_name='tempest-TestStampPattern-server-1249359891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1249359891',id=43,image_ref='21439d94-30f7-4f94-9eba-3e1a11063533',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY/XNxT3bZdfbS7bA8TEGYcJcrnDZXILC+YdYHyiQNZqB7M8VNeazxYLUF69qWftbyUFlAVIUHgkPt223heRLbEHqBn6l2ugX2Ts6mv/TBI7i/pV0nvB9213qET7Ai/mA==',key_name='tempest-TestStampPattern-1069318120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e8acd0141444fa2ae4dd9f49267715a',ramdisk_id='',reservation_id='r-r6w4aiv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='35db9646-f68d-4180-94cd-9cce20c0756f',image_min_disk='1',image_min_ram='0',image_owner_id='8e8acd0141444fa2ae4dd9f49267715a',image_owner_project_name='tempest-TestStampPattern-1148836256',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1148836256-project-member',image_user_id='ebdff923d6304b37880ae8bd217f2f3a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1148836256',owner_user_name='tempest-TestStampPattern-1148836256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:51:52Z,user_data=None,user_id='ebdff923d6304b37880ae8bd217f2f3a',uuid=79b0e968-4730-4abd-b252-3f7d140b18d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converting VIF {"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG os_vif [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee247cde-b0e2-5c1a-a20e-1a822a82d1ef', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7320273c-b4, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7320273c-b4, col_values=(('qos', UUID('270a74bd-4023-43cb-89e8-134594aa3509')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7320273c-b4, col_values=(('external_ids', {'iface-id': '7320273c-b4ff-4c16-bf72-c01547e92972', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:47:d6', 'vm-uuid': '79b0e968-4730-4abd-b252-3f7d140b18d1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:54 user nova-compute[74048]: INFO os_vif [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4')
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No VIF found with MAC fa:16:3e:c2:47:d6, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updated VIF entry in instance network info cache for port 7320273c-b4ff-4c16-bf72-c01547e92972. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG nova.network.neutron [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating instance_info_cache with network_info: [{"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-27a02f08-7da3-4f5e-b2f1-8220a3756cc7 req-261b09b2-dfd0-4ca5-b183-46d413852de9 service nova] Releasing lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:51:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:51:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Skipping network cache update for instance because it is Building. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-7172ed17-5821-4558-ad0b-0c608f00e2fd req-f73dc654-7f04-4693-b5d7-b153d9402fa4 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7172ed17-5821-4558-ad0b-0c608f00e2fd req-f73dc654-7f04-4693-b5d7-b153d9402fa4 service nova] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7172ed17-5821-4558-ad0b-0c608f00e2fd req-f73dc654-7f04-4693-b5d7-b153d9402fa4 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7172ed17-5821-4558-ad0b-0c608f00e2fd req-f73dc654-7f04-4693-b5d7-b153d9402fa4 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.compute.manager [req-7172ed17-5821-4558-ad0b-0c608f00e2fd req-f73dc654-7f04-4693-b5d7-b153d9402fa4 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] No waiting events found dispatching network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:56 user nova-compute[74048]: WARNING nova.compute.manager [req-7172ed17-5821-4558-ad0b-0c608f00e2fd req-f73dc654-7f04-4693-b5d7-b153d9402fa4 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received unexpected event network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 for instance with vm_state building and task_state spawning.
Oct 25 16:51:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:51:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-360ddacb-6ac0-43c9-b584-4ea59e95283d req-24a8707b-0d9b-4bf5-841c-024e60354d33 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-360ddacb-6ac0-43c9-b584-4ea59e95283d req-24a8707b-0d9b-4bf5-841c-024e60354d33 service nova] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-360ddacb-6ac0-43c9-b584-4ea59e95283d req-24a8707b-0d9b-4bf5-841c-024e60354d33 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-360ddacb-6ac0-43c9-b584-4ea59e95283d req-24a8707b-0d9b-4bf5-841c-024e60354d33 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-360ddacb-6ac0-43c9-b584-4ea59e95283d req-24a8707b-0d9b-4bf5-841c-024e60354d33 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] No waiting events found dispatching network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:51:58 user nova-compute[74048]: WARNING nova.compute.manager [req-360ddacb-6ac0-43c9-b584-4ea59e95283d req-24a8707b-0d9b-4bf5-841c-024e60354d33 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received unexpected event network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 for instance with vm_state building and task_state spawning.
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:51:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Instance spawned successfully.
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:51:58 user nova-compute[74048]: INFO nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Took 6.82 seconds to spawn the instance on the hypervisor.
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:51:58 user nova-compute[74048]: INFO nova.compute.manager [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Took 7.56 seconds to build instance.
Oct 25 16:51:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:51:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-cfa4af14-da9a-4df2-bb82-a2fdd1d8eb4e tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.678s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:52:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8367MB free_disk=24.962570190429688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 54b28e3c-f604-4d30-ac14-805da155813d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 79b0e968-4730-4abd-b252-3f7d140b18d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:52:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "54b28e3c-f604-4d30-ac14-805da155813d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:06 user nova-compute[74048]: INFO nova.compute.manager [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Terminating instance
Oct 25 16:52:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-42005c98-8a51-4166-9382-3407be651b3e req-1722db31-183c-4cdb-b8d0-eb2a3ca1219f service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-42005c98-8a51-4166-9382-3407be651b3e req-1722db31-183c-4cdb-b8d0-eb2a3ca1219f service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-42005c98-8a51-4166-9382-3407be651b3e req-1722db31-183c-4cdb-b8d0-eb2a3ca1219f service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-42005c98-8a51-4166-9382-3407be651b3e req-1722db31-183c-4cdb-b8d0-eb2a3ca1219f service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-42005c98-8a51-4166-9382-3407be651b3e req-1722db31-183c-4cdb-b8d0-eb2a3ca1219f service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-42005c98-8a51-4166-9382-3407be651b3e req-1722db31-183c-4cdb-b8d0-eb2a3ca1219f service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-unplugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Instance destroyed successfully.
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.objects.instance [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'resources' on Instance uuid 54b28e3c-f604-4d30-ac14-805da155813d {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1501783072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1501783072',id=25,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:37:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-lqxy30xy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:39:17Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=54b28e3c-f604-4d30-ac14-805da155813d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "address": "fa:16:3e:ed:63:3e", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f4f96-f7", "ovs_interfaceid": "da4f4f96-f7ae-49b9-988f-823a9abebd58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_vif [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda4f4f96-f7, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=453f5280-6b80-445c-b179-149366d43ce3) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:52:07 user nova-compute[74048]: INFO os_vif [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=da4f4f96-f7ae-49b9-988f-823a9abebd58,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f4f96-f7')
Oct 25 16:52:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LanFJviy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:52:07 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c32af-e51c-46ef-9f00-61826ac979cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:52:07 user nova-compute[74048]: No targets found.
Oct 25 16:52:07 user nova-compute[74048]: iSNS:
Oct 25 16:52:07 user nova-compute[74048]: No targets found.
Oct 25 16:52:07 user nova-compute[74048]: STATIC:
Oct 25 16:52:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:52:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:52:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:52:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208
Oct 25 16:52:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:52:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:52:07 user nova-compute[74048]: FIRMWARE:
Oct 25 16:52:07 user nova-compute[74048]: No targets found.
Oct 25 16:52:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:52:07 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:52:07 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f12a7ae-112f-411f-a077-9228e8e3c607]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba12d25-3677-4837-952f-ea2b9f22f80b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:52:07 user nova-compute[74048]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:52:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 (non-flash)
Oct 25 16:52:07 user nova-compute[74048]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:52:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184053e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208'): ({'sdd'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Removing single pathed devices sdd {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fddd4c-e76d-451e-b440-d71828bf3645]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb44f78-70a7-4898-bcfd-4bef288d7d79]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Flushing IO for device /dev/sdd {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[180a034c-c32d-4ef5-a6e4-9a18dae2d9a1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43143bb0-6105-4bf2-bd18-cb2f43712d82]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa573448-c3b3-4ce5-b9d3-fa7c9b198495]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250412d-dcfb-46e6-ae3d-2a654db2b56f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260]
Oct 25 16:52:08 user nova-compute[74048]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208, portal: 172.16.0.220,3260] successful.
Oct 25 16:52:08 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a0cafc-b396-4943-8baa-b238e9958208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be248ca-74be-4e06-9660-13e1e5d4e422]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] <== disconnect_volume: return (314ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:52:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Deleting instance files /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d_del
Oct 25 16:52:08 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Deletion of /opt/stack/data/nova/instances/54b28e3c-f604-4d30-ac14-805da155813d_del complete
Oct 25 16:52:08 user nova-compute[74048]: INFO nova.compute.manager [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 25 16:52:08 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:52:08 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Took 0.53 seconds to deallocate network for instance.
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-a52806dc-054c-4d3f-8d03-14a047e228d6 req-3df5e404-c09c-4880-bc8c-a240d90f750d service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-deleted-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:08 user nova-compute[74048]: INFO nova.compute.manager [req-a52806dc-054c-4d3f-8d03-14a047e228d6 req-3df5e404-c09c-4880-bc8c-a240d90f750d service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Neutron deleted interface da4f4f96-f7ae-49b9-988f-823a9abebd58; detaching it from the instance and deleting it from the info cache
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.network.neutron [req-a52806dc-054c-4d3f-8d03-14a047e228d6 req-3df5e404-c09c-4880-bc8c-a240d90f750d service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:52:08 user nova-compute[74048]: DEBUG nova.compute.manager [req-a52806dc-054c-4d3f-8d03-14a047e228d6 req-3df5e404-c09c-4880-bc8c-a240d90f750d service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Detach interface failed, port_id=da4f4f96-f7ae-49b9-988f-823a9abebd58, reason: Instance 54b28e3c-f604-4d30-ac14-805da155813d could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:52:09 user nova-compute[74048]: INFO nova.compute.claims [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Claim successful on node user
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-b36df8ef-14ad-4dee-8418-961381448556 req-abfe2693-133b-4ccd-8708-dcc7c2b4acd8 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b36df8ef-14ad-4dee-8418-961381448556 req-abfe2693-133b-4ccd-8708-dcc7c2b4acd8 service nova] Acquiring lock "54b28e3c-f604-4d30-ac14-805da155813d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b36df8ef-14ad-4dee-8418-961381448556 req-abfe2693-133b-4ccd-8708-dcc7c2b4acd8 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b36df8ef-14ad-4dee-8418-961381448556 req-abfe2693-133b-4ccd-8708-dcc7c2b4acd8 service nova] Lock "54b28e3c-f604-4d30-ac14-805da155813d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-b36df8ef-14ad-4dee-8418-961381448556 req-abfe2693-133b-4ccd-8708-dcc7c2b4acd8 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] No waiting events found dispatching network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:52:09 user nova-compute[74048]: WARNING nova.compute.manager [req-b36df8ef-14ad-4dee-8418-961381448556 req-abfe2693-133b-4ccd-8708-dcc7c2b4acd8 service nova] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Received unexpected event network-vif-plugged-da4f4f96-f7ae-49b9-988f-823a9abebd58 for instance with vm_state active and task_state deleting.
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:52:09 user nova-compute[74048]: INFO nova.compute.manager [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: 54b28e3c-f604-4d30-ac14-805da155813d] Took 1.00 seconds to detach 1 volumes for instance.
Oct 25 16:52:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:09 user nova-compute[74048]: INFO nova.virt.block_device [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Booting with volume 83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 at /dev/vda
Oct 25 16:52:09 user nova-compute[74048]: DEBUG nova.policy [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c809d630a78d4ce4bef9a9462543d2ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad2347aaae1424681b490608fde8b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG os_brick.utils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e6cd69-2aa3-4f1d-a516-e9a37bc10a69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab9fd8e-8cdf-4ec2-8e80-1d1d621da6c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[41231eae-d16d-499b-a1f3-19c3ca2e1718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc1e23f-72ab-4447-91d7-49d5ffe4bb77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:52:10 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba04ff-c92f-488f-a595-afb5dcf60248]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG os_brick.utils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating existing volume attachment record: 59b8191e-674b-4100-a440-b99a572c1337 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:10 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Deleted allocations for instance 54b28e3c-f604-4d30-ac14-805da155813d
Oct 25 16:52:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-12ca14b8-43d7-4e51-a5f4-c42729200c71 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "54b28e3c-f604-4d30-ac14-805da155813d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.412s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:10 user nova-compute[74048]: DEBUG nova.network.neutron [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Successfully created port: 63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Successfully updated port: 63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-changed-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Refreshing instance network info cache due to event network-changed-63d164cb-be72-47b9-b2f2-caf7d3118679. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.network.neutron [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance network_info: |[{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:52:11 user nova-compute[74048]: DEBUG nova.network.neutron [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Refreshing network info cache for port 63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:52:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updated VIF entry in instance network info cache for port 63d164cb-be72-47b9-b2f2-caf7d3118679. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:52:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:52:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b422b491-7d09-4643-ab36-c4cc160122da req-44f009c9-beb8-4e07-9ff4-b4cb5e2472f2 service nova] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:52:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:52:28 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Creating image(s)
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Ensure instance console log exists: /opt/stack/data/nova/instances/8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Start _get_guest_xml network_info=[{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '59b8191e-674b-4100-a440-b99a572c1337', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e', 'attached_at': '', 'detached_at': '', 'volume_id': '83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'serial': '83f10dfe-a4df-4f49-8800-4ae1e5cc9c47'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:52:28 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:52:28 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:52:28 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:52:28 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:52:28 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b7c5a-465d-4693-837d-e6d588f4abb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:52:28 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081bcee-93f8-4da5-ab0c-7601707d5d3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47] added
Oct 25 16:52:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c20e9d0-538c-4501-ade2-bc7b27b49d9d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb39af-f9c8-4a34-9119-eeb2f1a7678d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnKxqXDF {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnKxqXDF" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826e10c-76fd-4549-a803-acb27f3123f2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnKxqXDF'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ff1239-f599-4019-8741-aac9ca2bb96d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f509424-fd9d-46a3-a597-133fea917b57]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:52:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:52:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632b417-bd9a-4938-b534-700725cfdffa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]
Oct 25 16:52:28 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.
Oct 25 16:52:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b428b3-0072-4079-bfb5-c1242f29f692]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3cb69-65ba-4c57-9831-c94de93d18aa]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:52:28 user nova-compute[74048]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:52:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:52:28 user nova-compute[74048]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:52:28 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56369c6-2021-4f85-9232-6f6811311e4b]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:52:28 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26637303266663332', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637303266663332', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:52:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-302978694',display_name='tempest-ServerActionsTestOtherA-server-302978694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-302978694',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-zkjnpk0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.objects.instance [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:52:29 user nova-compute[74048]:   <uuid>8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e</uuid>
Oct 25 16:52:29 user nova-compute[74048]:   <name>instance-0000002c</name>
Oct 25 16:52:29 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:52:29 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:52:29 user nova-compute[74048]:   <metadata>
Oct 25 16:52:29 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:52:29 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:52:29 user nova-compute[74048]:       <nova:name>tempest-ServerActionsTestOtherA-server-302978694</nova:name>
Oct 25 16:52:29 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:52:28</nova:creationTime>
Oct 25 16:52:29 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:52:29 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:52:29 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:52:29 user nova-compute[74048]:       <nova:owner>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:user uuid="c809d630a78d4ce4bef9a9462543d2ad">tempest-ServerActionsTestOtherA-318048713-project-member</nova:user>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:project uuid="8ad2347aaae1424681b490608fde8b08">tempest-ServerActionsTestOtherA-318048713</nova:project>
Oct 25 16:52:29 user nova-compute[74048]:       </nova:owner>
Oct 25 16:52:29 user nova-compute[74048]:       <nova:ports>
Oct 25 16:52:29 user nova-compute[74048]:         <nova:port uuid="63d164cb-be72-47b9-b2f2-caf7d3118679">
Oct 25 16:52:29 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:52:29 user nova-compute[74048]:         </nova:port>
Oct 25 16:52:29 user nova-compute[74048]:       </nova:ports>
Oct 25 16:52:29 user nova-compute[74048]:     </nova:instance>
Oct 25 16:52:29 user nova-compute[74048]:   </metadata>
Oct 25 16:52:29 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:52:29 user nova-compute[74048]:     <system>
Oct 25 16:52:29 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:52:29 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:52:29 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:52:29 user nova-compute[74048]:       <entry name="serial">8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e</entry>
Oct 25 16:52:29 user nova-compute[74048]:       <entry name="uuid">8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e</entry>
Oct 25 16:52:29 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:52:29 user nova-compute[74048]:     </system>
Oct 25 16:52:29 user nova-compute[74048]:   </sysinfo>
Oct 25 16:52:29 user nova-compute[74048]:   <os>
Oct 25 16:52:29 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:52:29 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:52:29 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:52:29 user nova-compute[74048]:   </os>
Oct 25 16:52:29 user nova-compute[74048]:   <features>
Oct 25 16:52:29 user nova-compute[74048]:     <acpi/>
Oct 25 16:52:29 user nova-compute[74048]:     <apic/>
Oct 25 16:52:29 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:52:29 user nova-compute[74048]:   </features>
Oct 25 16:52:29 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:52:29 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:52:29 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:52:29 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:52:29 user nova-compute[74048]:   </clock>
Oct 25 16:52:29 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:52:29 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:52:29 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:52:29 user nova-compute[74048]:   </cpu>
Oct 25 16:52:29 user nova-compute[74048]:   <devices>
Oct 25 16:52:29 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:52:29 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:52:29 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:52:29 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:52:29 user nova-compute[74048]:       <serial>83f10dfe-a4df-4f49-8800-4ae1e5cc9c47</serial>
Oct 25 16:52:29 user nova-compute[74048]:     </disk>
Oct 25 16:52:29 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:52:29 user nova-compute[74048]:       <mac address="fa:16:3e:48:0b:54"/>
Oct 25 16:52:29 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:52:29 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:52:29 user nova-compute[74048]:       <target dev="tap63d164cb-be"/>
Oct 25 16:52:29 user nova-compute[74048]:     </interface>
Oct 25 16:52:29 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:52:29 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e/console.log" append="off"/>
Oct 25 16:52:29 user nova-compute[74048]:     </serial>
Oct 25 16:52:29 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:52:29 user nova-compute[74048]:     <video>
Oct 25 16:52:29 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:52:29 user nova-compute[74048]:     </video>
Oct 25 16:52:29 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:52:29 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:52:29 user nova-compute[74048]:     </rng>
Oct 25 16:52:29 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:52:29 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:52:29 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:52:29 user nova-compute[74048]:     </memballoon>
Oct 25 16:52:29 user nova-compute[74048]:   </devices>
Oct 25 16:52:29 user nova-compute[74048]: </domain>
Oct 25 16:52:29 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:52:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-302978694',display_name='tempest-ServerActionsTestOtherA-server-302978694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-302978694',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-zkjnpk0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:52:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG os_vif [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71d59fff-449b-5217-9883-4c27c2bf8d8c', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63d164cb-be, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63d164cb-be, col_values=(('qos', UUID('4d3e7999-8bce-4b0c-aa82-24ba8db176b5')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63d164cb-be, col_values=(('external_ids', {'iface-id': '63d164cb-be72-47b9-b2f2-caf7d3118679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0b:54', 'vm-uuid': '8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:29 user nova-compute[74048]: INFO os_vif [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be')
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:52:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No VIF found with MAC fa:16:3e:48:0b:54, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:52:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-1ee348d6-21a1-4be4-93a6-ed436596a6cf req-85ee8fd5-b865-47fa-acfd-3aaa71444e11 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1ee348d6-21a1-4be4-93a6-ed436596a6cf req-85ee8fd5-b865-47fa-acfd-3aaa71444e11 service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1ee348d6-21a1-4be4-93a6-ed436596a6cf req-85ee8fd5-b865-47fa-acfd-3aaa71444e11 service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1ee348d6-21a1-4be4-93a6-ed436596a6cf req-85ee8fd5-b865-47fa-acfd-3aaa71444e11 service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-1ee348d6-21a1-4be4-93a6-ed436596a6cf req-85ee8fd5-b865-47fa-acfd-3aaa71444e11 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:52:31 user nova-compute[74048]: WARNING nova.compute.manager [req-1ee348d6-21a1-4be4-93a6-ed436596a6cf req-85ee8fd5-b865-47fa-acfd-3aaa71444e11 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state building and task_state spawning.
Oct 25 16:52:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:32 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:52:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:52:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance spawned successfully.
Oct 25 16:52:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-5a9c69cf-c0a3-4ad2-b464-986b9fe6da55 req-aabc7438-16dc-4c01-953d-2ead4d6e2605 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5a9c69cf-c0a3-4ad2-b464-986b9fe6da55 req-aabc7438-16dc-4c01-953d-2ead4d6e2605 service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5a9c69cf-c0a3-4ad2-b464-986b9fe6da55 req-aabc7438-16dc-4c01-953d-2ead4d6e2605 service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-5a9c69cf-c0a3-4ad2-b464-986b9fe6da55 req-aabc7438-16dc-4c01-953d-2ead4d6e2605 service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-5a9c69cf-c0a3-4ad2-b464-986b9fe6da55 req-aabc7438-16dc-4c01-953d-2ead4d6e2605 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:52:33 user nova-compute[74048]: WARNING nova.compute.manager [req-5a9c69cf-c0a3-4ad2-b464-986b9fe6da55 req-aabc7438-16dc-4c01-953d-2ead4d6e2605 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state building and task_state spawning.
Oct 25 16:52:33 user nova-compute[74048]: INFO nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Took 5.10 seconds to spawn the instance on the hypervisor.
Oct 25 16:52:33 user nova-compute[74048]: DEBUG nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:52:33 user nova-compute[74048]: INFO nova.compute.manager [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Took 23.98 seconds to build instance.
Oct 25 16:52:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-99b321d6-724b-4ae0-b8d5-baa586197e03 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.117s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:42 user nova-compute[74048]: INFO nova.compute.manager [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Detaching volume fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:52:42 user nova-compute[74048]: INFO nova.virt.block_device [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Attempting to driver detach volume fbaabef9-6d7f-44d5-87b8-a2690e072b45 from mountpoint /dev/vdb
Oct 25 16:52:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Attempting to detach device vdb from instance 063fb985-6780-4196-90b6-dc92ab263244 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:52:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:52:42 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:52:42 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:52:42 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:52:42 user nova-compute[74048]:   <serial>fbaabef9-6d7f-44d5-87b8-a2690e072b45</serial>
Oct 25 16:52:42 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 16:52:42 user nova-compute[74048]: </disk>
Oct 25 16:52:42 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:52:42 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully detached device vdb from instance 063fb985-6780-4196-90b6-dc92ab263244 from the persistent domain config.
Oct 25 16:52:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 063fb985-6780-4196-90b6-dc92ab263244 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:52:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:52:42 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:52:42 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:52:42 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:52:42 user nova-compute[74048]:   <serial>fbaabef9-6d7f-44d5-87b8-a2690e072b45</serial>
Oct 25 16:52:42 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 16:52:42 user nova-compute[74048]: </disk>
Oct 25 16:52:42 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:52:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:52:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:52 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:52:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:54 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:55 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:57 user nova-compute[74048]: INFO nova.compute.manager [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Terminating instance
Oct 25 16:52:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:52:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-251c35ff-b53c-4a3b-a63a-23ce7d07f08d req-1aafc30a-45d4-4e11-a4f0-c2e0341e0de6 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-vif-unplugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-251c35ff-b53c-4a3b-a63a-23ce7d07f08d req-1aafc30a-45d4-4e11-a4f0-c2e0341e0de6 service nova] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-251c35ff-b53c-4a3b-a63a-23ce7d07f08d req-1aafc30a-45d4-4e11-a4f0-c2e0341e0de6 service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-251c35ff-b53c-4a3b-a63a-23ce7d07f08d req-1aafc30a-45d4-4e11-a4f0-c2e0341e0de6 service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-251c35ff-b53c-4a3b-a63a-23ce7d07f08d req-1aafc30a-45d4-4e11-a4f0-c2e0341e0de6 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] No waiting events found dispatching network-vif-unplugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-251c35ff-b53c-4a3b-a63a-23ce7d07f08d req-1aafc30a-45d4-4e11-a4f0-c2e0341e0de6 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-vif-unplugged-239dfdcc-6832-41bb-af41-3b6b56584e3a for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:52:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:52:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Instance destroyed successfully.
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.objects.instance [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lazy-loading 'resources' on Instance uuid d587e48c-2104-4f0b-a12c-7334a63d3d5f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:52:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:52:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8125MB free_disk=24.93259048461914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:32:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1469094947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1469094947',id=20,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:32:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4412dd65efab430eb361b71f048d3575',ramdisk_id='',reservation_id='r-s9j3wvt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-399579320',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:34:27Z,user_data=None,user_id='6a2170a4f3e541bea8147fbf3bc6b746',uuid=d587e48c-2104-4f0b-a12c-7334a63d3d5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converting VIF {"id": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "address": "fa:16:3e:9b:a8:7d", "network": {"id": "5e05381c-b0a7-41c1-a3c1-665d8254bec1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1047457352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4412dd65efab430eb361b71f048d3575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239dfdcc-68", "ovs_interfaceid": "239dfdcc-6832-41bb-af41-3b6b56584e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG os_vif [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap239dfdcc-68, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=163f194f-bbfc-4d63-9708-53bad46ec75b) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:52:59 user nova-compute[74048]: INFO os_vif [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:a8:7d,bridge_name='br-int',has_traffic_filtering=True,id=239dfdcc-6832-41bb-af41-3b6b56584e3a,network=Network(5e05381c-b0a7-41c1-a3c1-665d8254bec1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239dfdcc-68')
Oct 25 16:52:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Deleting instance files /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f_del
Oct 25 16:52:59 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Deletion of /opt/stack/data/nova/instances/d587e48c-2104-4f0b-a12c-7334a63d3d5f_del complete
Oct 25 16:52:59 user nova-compute[74048]: INFO nova.compute.manager [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 25 16:52:59 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 79b0e968-4730-4abd-b252-3f7d140b18d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:52:59 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Took 0.70 seconds to deallocate network for instance.
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-1ac09e6a-5522-47b0-91bc-df85b85e8398 req-e4678f2b-236b-4ad5-80a6-b2777c03ecfc service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-vif-deleted-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:52:59 user nova-compute[74048]: INFO nova.compute.manager [req-1ac09e6a-5522-47b0-91bc-df85b85e8398 req-e4678f2b-236b-4ad5-80a6-b2777c03ecfc service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Neutron deleted interface 239dfdcc-6832-41bb-af41-3b6b56584e3a; detaching it from the instance and deleting it from the info cache
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.network.neutron [req-1ac09e6a-5522-47b0-91bc-df85b85e8398 req-e4678f2b-236b-4ad5-80a6-b2777c03ecfc service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:52:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-1ac09e6a-5522-47b0-91bc-df85b85e8398 req-e4678f2b-236b-4ad5-80a6-b2777c03ecfc service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Detach interface failed, port_id=239dfdcc-6832-41bb-af41-3b6b56584e3a, reason: Instance d587e48c-2104-4f0b-a12c-7334a63d3d5f could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:00 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Deleted allocations for instance d587e48c-2104-4f0b-a12c-7334a63d3d5f
Oct 25 16:53:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-eb60c824-0124-4f30-a0a1-f1a237053550 req-dc68985b-32e4-4b59-a69a-f264493c0132 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received event network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-eb60c824-0124-4f30-a0a1-f1a237053550 req-dc68985b-32e4-4b59-a69a-f264493c0132 service nova] Acquiring lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-eb60c824-0124-4f30-a0a1-f1a237053550 req-dc68985b-32e4-4b59-a69a-f264493c0132 service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-eb60c824-0124-4f30-a0a1-f1a237053550 req-dc68985b-32e4-4b59-a69a-f264493c0132 service nova] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-eb60c824-0124-4f30-a0a1-f1a237053550 req-dc68985b-32e4-4b59-a69a-f264493c0132 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] No waiting events found dispatching network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:00 user nova-compute[74048]: WARNING nova.compute.manager [req-eb60c824-0124-4f30-a0a1-f1a237053550 req-dc68985b-32e4-4b59-a69a-f264493c0132 service nova] [instance: d587e48c-2104-4f0b-a12c-7334a63d3d5f] Received unexpected event network-vif-plugged-239dfdcc-6832-41bb-af41-3b6b56584e3a for instance with vm_state deleted and task_state None.
Oct 25 16:53:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6cda5ebd-39be-4d22-9b6f-ffde53d1afb2 tempest-ServerBootFromVolumeStableRescueTest-399579320 tempest-ServerBootFromVolumeStableRescueTest-399579320-project-member] Lock "d587e48c-2104-4f0b-a12c-7334a63d3d5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:53:01 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:02 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 063fb985-6780-4196-90b6-dc92ab263244 is timed out.
Oct 25 16:53:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully detached device vdb from instance 063fb985-6780-4196-90b6-dc92ab263244 from the live domain config.
Oct 25 16:53:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWHvraNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:53:02 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6c3ef-45ab-4370-9182-32f544a71d18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24070a05-03fe-44a0-8f50-eaa474ec74ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:53:02 user nova-compute[74048]: No targets found.
Oct 25 16:53:02 user nova-compute[74048]: iSNS:
Oct 25 16:53:02 user nova-compute[74048]: No targets found.
Oct 25 16:53:02 user nova-compute[74048]: STATIC:
Oct 25 16:53:02 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45
Oct 25 16:53:02 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:53:02 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:53:02 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:24070a05-03fe-44a0-8f50-eaa474ec74ed
Oct 25 16:53:02 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:53:02 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:53:02 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:53:02 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:53:02 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:53:02 user nova-compute[74048]: FIRMWARE:
Oct 25 16:53:02 user nova-compute[74048]: No targets found.
Oct 25 16:53:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:53:02 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:53:02 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a782b346-88fc-4638-aef0-cb3542d7aa47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24070a05-03fe-44a0-8f50-eaa474ec74ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75800d2-afe1-4425-bf1a-b012c7cf64fa]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:53:02 user nova-compute[74048]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:53:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 (non-flash)
Oct 25 16:53:02 user nova-compute[74048]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:53:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18406c2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd6393-8e7e-471f-9fb8-37cd743faea4]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b1b3c-42a1-45d4-ace1-012630fa38de]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[11250448-7df4-462b-9b07-964c5bf037d0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e12b6b-31c8-4a4b-a9db-8a03a1fd01f1]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e387c077-c354-465a-b8bb-7928c47c68a4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf01520-aa87-4736-ba6f-ac3568bf99aa]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260]
Oct 25 16:53:02 user nova-compute[74048]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45, portal: 172.16.0.220,3260] successful.
Oct 25 16:53:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:53:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbaabef9-6d7f-44d5-87b8-a2690e072b45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d409b-33ed-4376-9c35-3a89e0764532]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== disconnect_volume: return (321ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG nova.objects.instance [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:53:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-ec0bc0b8-6356-4f40-a00c-45bb27c66be1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74048) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-88b047c7-a8b9-4d21-b33a-dd945d8b4da7 req-8306514a-7c77-47b6-9b6e-4fc96a44c165 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-88b047c7-a8b9-4d21-b33a-dd945d8b4da7 req-8306514a-7c77-47b6-9b6e-4fc96a44c165 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-88b047c7-a8b9-4d21-b33a-dd945d8b4da7 req-8306514a-7c77-47b6-9b6e-4fc96a44c165 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-88b047c7-a8b9-4d21-b33a-dd945d8b4da7 req-8306514a-7c77-47b6-9b6e-4fc96a44c165 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-88b047c7-a8b9-4d21-b33a-dd945d8b4da7 req-8306514a-7c77-47b6-9b6e-4fc96a44c165 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:05 user nova-compute[74048]: WARNING nova.compute.manager [req-88b047c7-a8b9-4d21-b33a-dd945d8b4da7 req-8306514a-7c77-47b6-9b6e-4fc96a44c165 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state active and task_state powering-off.
Oct 25 16:53:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance destroyed successfully.
Oct 25 16:53:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:53:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f324acc7-4c30-4913-ac92-e8b995b68cb1 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.879s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-40acf5df-b343-44ba-867d-86ef926cd481 req-499faa0e-81e9-44c4-8abb-8d5f9916313e service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-40acf5df-b343-44ba-867d-86ef926cd481 req-499faa0e-81e9-44c4-8abb-8d5f9916313e service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-40acf5df-b343-44ba-867d-86ef926cd481 req-499faa0e-81e9-44c4-8abb-8d5f9916313e service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-40acf5df-b343-44ba-867d-86ef926cd481 req-499faa0e-81e9-44c4-8abb-8d5f9916313e service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:07 user nova-compute[74048]: DEBUG nova.compute.manager [req-40acf5df-b343-44ba-867d-86ef926cd481 req-499faa0e-81e9-44c4-8abb-8d5f9916313e service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:07 user nova-compute[74048]: WARNING nova.compute.manager [req-40acf5df-b343-44ba-867d-86ef926cd481 req-499faa0e-81e9-44c4-8abb-8d5f9916313e service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state stopped and task_state None.
Oct 25 16:53:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:53:13 user nova-compute[74048]: INFO nova.compute.claims [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Claim successful on node user
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:53:13 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:53:13 user nova-compute[74048]: DEBUG nova.policy [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd15a2b8965674044bc470c92ab59febb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5779faa4ac7c43eeab1e725056249db5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:53:14 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Creating image(s)
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "/opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "/opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "/opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk 1073741824" returned: 0 in 0.055s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Successfully created port: d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Cannot resize image /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Ensure instance console log exists: /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Successfully updated port: d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquired lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-changed-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG nova.compute.manager [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Refreshing instance network info cache due to event network-changed-d511c524-6a09-41bf-ab73-4dc476971275. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] Acquiring lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:53:15 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.neutron [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating instance_info_cache with network_info: [{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Releasing lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Instance network_info: |[{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] Acquired lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Refreshing network info cache for port d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Start _get_guest_xml network_info=[{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:53:16 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:53:16 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1193461110',display_name='tempest-SnapshotDataIntegrityTests-server-1193461110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1193461110',id=45,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSw5dkBxJZzQlCcHuiJhKwGKukrdY9rTG4S/pLoF77q8QaCHFomFGVpvd6fHltOoP8wqCqvTy4928lv3L1zaNa6910q1sul4KaNLlk3EVykU49ftAjGtdpjFo9CTeNgdg==',key_name='tempest-keypair-1893477291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5779faa4ac7c43eeab1e725056249db5',ramdisk_id='',reservation_id='r-m1wbyio5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-283064237',owner_user_name='tempest-SnapshotDataIntegrityTests-283064237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d15a2b8965674044bc470c92ab59febb',uuid=84006653-191e-4f73-b505-741e2abb95ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Converting VIF {"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'pci_devices' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:53:16 user nova-compute[74048]:   <uuid>84006653-191e-4f73-b505-741e2abb95ab</uuid>
Oct 25 16:53:16 user nova-compute[74048]:   <name>instance-0000002d</name>
Oct 25 16:53:16 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:53:16 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:53:16 user nova-compute[74048]:   <metadata>
Oct 25 16:53:16 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:53:16 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:53:16 user nova-compute[74048]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1193461110</nova:name>
Oct 25 16:53:16 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:53:16</nova:creationTime>
Oct 25 16:53:16 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:53:16 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:53:16 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:53:16 user nova-compute[74048]:       <nova:owner>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:user uuid="d15a2b8965674044bc470c92ab59febb">tempest-SnapshotDataIntegrityTests-283064237-project-member</nova:user>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:project uuid="5779faa4ac7c43eeab1e725056249db5">tempest-SnapshotDataIntegrityTests-283064237</nova:project>
Oct 25 16:53:16 user nova-compute[74048]:       </nova:owner>
Oct 25 16:53:16 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:53:16 user nova-compute[74048]:       <nova:ports>
Oct 25 16:53:16 user nova-compute[74048]:         <nova:port uuid="d511c524-6a09-41bf-ab73-4dc476971275">
Oct 25 16:53:16 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 16:53:16 user nova-compute[74048]:         </nova:port>
Oct 25 16:53:16 user nova-compute[74048]:       </nova:ports>
Oct 25 16:53:16 user nova-compute[74048]:     </nova:instance>
Oct 25 16:53:16 user nova-compute[74048]:   </metadata>
Oct 25 16:53:16 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:53:16 user nova-compute[74048]:     <system>
Oct 25 16:53:16 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:53:16 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:53:16 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:53:16 user nova-compute[74048]:       <entry name="serial">84006653-191e-4f73-b505-741e2abb95ab</entry>
Oct 25 16:53:16 user nova-compute[74048]:       <entry name="uuid">84006653-191e-4f73-b505-741e2abb95ab</entry>
Oct 25 16:53:16 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:53:16 user nova-compute[74048]:     </system>
Oct 25 16:53:16 user nova-compute[74048]:   </sysinfo>
Oct 25 16:53:16 user nova-compute[74048]:   <os>
Oct 25 16:53:16 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:53:16 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:53:16 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:53:16 user nova-compute[74048]:   </os>
Oct 25 16:53:16 user nova-compute[74048]:   <features>
Oct 25 16:53:16 user nova-compute[74048]:     <acpi/>
Oct 25 16:53:16 user nova-compute[74048]:     <apic/>
Oct 25 16:53:16 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:53:16 user nova-compute[74048]:   </features>
Oct 25 16:53:16 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:53:16 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:53:16 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:53:16 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:53:16 user nova-compute[74048]:   </clock>
Oct 25 16:53:16 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:53:16 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:53:16 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:53:16 user nova-compute[74048]:   </cpu>
Oct 25 16:53:16 user nova-compute[74048]:   <devices>
Oct 25 16:53:16 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:53:16 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:53:16 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk"/>
Oct 25 16:53:16 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:53:16 user nova-compute[74048]:     </disk>
Oct 25 16:53:16 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:53:16 user nova-compute[74048]:       <mac address="fa:16:3e:a7:b2:ce"/>
Oct 25 16:53:16 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:53:16 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:53:16 user nova-compute[74048]:       <target dev="tapd511c524-6a"/>
Oct 25 16:53:16 user nova-compute[74048]:     </interface>
Oct 25 16:53:16 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:53:16 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/console.log" append="off"/>
Oct 25 16:53:16 user nova-compute[74048]:     </serial>
Oct 25 16:53:16 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:53:16 user nova-compute[74048]:     <video>
Oct 25 16:53:16 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:53:16 user nova-compute[74048]:     </video>
Oct 25 16:53:16 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:53:16 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:53:16 user nova-compute[74048]:     </rng>
Oct 25 16:53:16 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:53:16 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:53:16 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:53:16 user nova-compute[74048]:     </memballoon>
Oct 25 16:53:16 user nova-compute[74048]:   </devices>
Oct 25 16:53:16 user nova-compute[74048]: </domain>
Oct 25 16:53:16 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1193461110',display_name='tempest-SnapshotDataIntegrityTests-server-1193461110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1193461110',id=45,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSw5dkBxJZzQlCcHuiJhKwGKukrdY9rTG4S/pLoF77q8QaCHFomFGVpvd6fHltOoP8wqCqvTy4928lv3L1zaNa6910q1sul4KaNLlk3EVykU49ftAjGtdpjFo9CTeNgdg==',key_name='tempest-keypair-1893477291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5779faa4ac7c43eeab1e725056249db5',ramdisk_id='',reservation_id='r-m1wbyio5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-283064237',owner_user_name='tempest-SnapshotDataIntegrityTests-283064237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d15a2b8965674044bc470c92ab59febb',uuid=84006653-191e-4f73-b505-741e2abb95ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Converting VIF {"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG os_vif [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '280c1c3d-c5cb-5b3d-828f-21e0e2763ede', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd511c524-6a, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd511c524-6a, col_values=(('qos', UUID('548d3481-fa56-404a-9224-1f17fbbd9111')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd511c524-6a, col_values=(('external_ids', {'iface-id': 'd511c524-6a09-41bf-ab73-4dc476971275', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:b2:ce', 'vm-uuid': '84006653-191e-4f73-b505-741e2abb95ab'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:16 user nova-compute[74048]: INFO os_vif [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a')
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No VIF found with MAC fa:16:3e:a7:b2:ce, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updated VIF entry in instance network info cache for port d511c524-6a09-41bf-ab73-4dc476971275. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG nova.network.neutron [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating instance_info_cache with network_info: [{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:53:16 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d1abcae8-abc1-4837-8752-c88cd5b82db9 req-8c377fb9-1e1d-4b49-b3b1-b7af3d03411a service nova] Releasing lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:53:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-4584dbf7-8b31-4d02-9853-b814bb2b134e req-10513cb7-cb3f-499c-8b91-62271640fd9e service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4584dbf7-8b31-4d02-9853-b814bb2b134e req-10513cb7-cb3f-499c-8b91-62271640fd9e service nova] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4584dbf7-8b31-4d02-9853-b814bb2b134e req-10513cb7-cb3f-499c-8b91-62271640fd9e service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4584dbf7-8b31-4d02-9853-b814bb2b134e req-10513cb7-cb3f-499c-8b91-62271640fd9e service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG nova.compute.manager [req-4584dbf7-8b31-4d02-9853-b814bb2b134e req-10513cb7-cb3f-499c-8b91-62271640fd9e service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] No waiting events found dispatching network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:18 user nova-compute[74048]: WARNING nova.compute.manager [req-4584dbf7-8b31-4d02-9853-b814bb2b134e req-10513cb7-cb3f-499c-8b91-62271640fd9e service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received unexpected event network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 for instance with vm_state building and task_state spawning.
Oct 25 16:53:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:53:20 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Instance spawned successfully.
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-58d55378-4b9e-4e4b-9850-bbcc8b7c9b2d req-65f4018b-1741-4806-a43d-81948499e1a0 service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-58d55378-4b9e-4e4b-9850-bbcc8b7c9b2d req-65f4018b-1741-4806-a43d-81948499e1a0 service nova] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-58d55378-4b9e-4e4b-9850-bbcc8b7c9b2d req-65f4018b-1741-4806-a43d-81948499e1a0 service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-58d55378-4b9e-4e4b-9850-bbcc8b7c9b2d req-65f4018b-1741-4806-a43d-81948499e1a0 service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.compute.manager [req-58d55378-4b9e-4e4b-9850-bbcc8b7c9b2d req-65f4018b-1741-4806-a43d-81948499e1a0 service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] No waiting events found dispatching network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:20 user nova-compute[74048]: WARNING nova.compute.manager [req-58d55378-4b9e-4e4b-9850-bbcc8b7c9b2d req-65f4018b-1741-4806-a43d-81948499e1a0 service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received unexpected event network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 for instance with vm_state building and task_state spawning.
Oct 25 16:53:20 user nova-compute[74048]: INFO nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Took 6.19 seconds to spawn the instance on the hypervisor.
Oct 25 16:53:20 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:53:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:20 user nova-compute[74048]: INFO nova.compute.manager [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Took 6.87 seconds to build instance.
Oct 25 16:53:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5a9c6014-0be3-4e2e-a370-e42fc7a00252 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.968s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-changed-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Refreshing instance network info cache due to event network-changed-7320273c-b4ff-4c16-bf72-c01547e92972. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:53:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] Acquiring lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:53:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] Acquired lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:53:42 user nova-compute[74048]: DEBUG nova.network.neutron [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Refreshing network info cache for port 7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updated VIF entry in instance network info cache for port 7320273c-b4ff-4c16-bf72-c01547e92972. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating instance_info_cache with network_info: [{"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-c13910d5-acf1-499a-8305-d1191883fc50 req-1cb87780-94dc-4986-9b8a-91c49534fe1b service nova] Releasing lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'flavor' on Instance uuid 79b0e968-4730-4abd-b252-3f7d140b18d1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:43 user nova-compute[74048]: INFO nova.compute.manager [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Attaching volume 98a68307-8bbd-4ebb-8bfc-2a3375625fb7 to /dev/vdb
Oct 25 16:53:43 user nova-compute[74048]: DEBUG os_brick.utils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d03a36-9977-4efd-b936-5133111b4ba0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e8c7a4-7b33-44f5-bf48-825dbd342ff6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4cae26-7661-4f23-a14d-5ae73ddafa84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0137d09d-76d3-4214-8464-0baa1aa9d39e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:53:43 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:53:43 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065bb6e-d873-40b8-9d30-9c26ff9648b1]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG os_brick.utils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:53:43 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating existing volume attachment record: f38b42ca-2d29-4129-a075-5f82d0657d72 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:53:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:45 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:53:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:53:45 user nova-compute[74048]: INFO nova.compute.claims [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Claim successful on node user
Oct 25 16:53:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:53:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.policy [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e78ebbfe155248d28d49a46798eb5870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28c6406a21048bd88b6defdb0547fba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:53:46 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Creating image(s)
Oct 25 16:53:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "/opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "/opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "/opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:46 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.270s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.235s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk 1073741824" returned: 0 in 0.058s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.241s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Successfully created port: c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Cannot resize image /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Ensure instance console log exists: /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Successfully updated port: c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquired lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.compute.manager [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-changed-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.compute.manager [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Refreshing instance network info cache due to event network-changed-c84911a8-a9b8-4332-bac3-a74108ba7273. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] Acquiring lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.neutron [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updating instance_info_cache with network_info: [{"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Releasing lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Instance network_info: |[{"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] Acquired lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.neutron [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Refreshing network info cache for port c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Start _get_guest_xml network_info=[{"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:53:48 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:53:48 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1395469249',display_name='tempest-VolumesSnapshotTestJSON-instance-1395469249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1395469249',id=46,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvbhrr47tKmiTM44P3uKZPgOvTZMoxSsFYZKmNlw0JIkeujNvKGqh1WI8Paa6RxFWTt7MWXf1rDrNH8tTGjU2ace37uPOjLErOyOsC8ik0bXPPYb1peWGY5VwA1K/FyA==',key_name='tempest-keypair-11629835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a28c6406a21048bd88b6defdb0547fba',ramdisk_id='',reservation_id='r-zh60xake',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1876187338',owner_user_name='tempest-VolumesSnapshotTestJSON-1876187338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78ebbfe155248d28d49a46798eb5870',uuid=37f397bc-dbe3-4285-a4db-cb3205fe88c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converting VIF {"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'pci_devices' on Instance uuid 37f397bc-dbe3-4285-a4db-cb3205fe88c1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:53:48 user nova-compute[74048]:   <uuid>37f397bc-dbe3-4285-a4db-cb3205fe88c1</uuid>
Oct 25 16:53:48 user nova-compute[74048]:   <name>instance-0000002e</name>
Oct 25 16:53:48 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:53:48 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:53:48 user nova-compute[74048]:   <metadata>
Oct 25 16:53:48 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:53:48 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:53:48 user nova-compute[74048]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1395469249</nova:name>
Oct 25 16:53:48 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:53:48</nova:creationTime>
Oct 25 16:53:48 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:53:48 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:53:48 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:53:48 user nova-compute[74048]:       <nova:owner>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:user uuid="e78ebbfe155248d28d49a46798eb5870">tempest-VolumesSnapshotTestJSON-1876187338-project-member</nova:user>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:project uuid="a28c6406a21048bd88b6defdb0547fba">tempest-VolumesSnapshotTestJSON-1876187338</nova:project>
Oct 25 16:53:48 user nova-compute[74048]:       </nova:owner>
Oct 25 16:53:48 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:53:48 user nova-compute[74048]:       <nova:ports>
Oct 25 16:53:48 user nova-compute[74048]:         <nova:port uuid="c84911a8-a9b8-4332-bac3-a74108ba7273">
Oct 25 16:53:48 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:53:48 user nova-compute[74048]:         </nova:port>
Oct 25 16:53:48 user nova-compute[74048]:       </nova:ports>
Oct 25 16:53:48 user nova-compute[74048]:     </nova:instance>
Oct 25 16:53:48 user nova-compute[74048]:   </metadata>
Oct 25 16:53:48 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:53:48 user nova-compute[74048]:     <system>
Oct 25 16:53:48 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:53:48 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:53:48 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:53:48 user nova-compute[74048]:       <entry name="serial">37f397bc-dbe3-4285-a4db-cb3205fe88c1</entry>
Oct 25 16:53:48 user nova-compute[74048]:       <entry name="uuid">37f397bc-dbe3-4285-a4db-cb3205fe88c1</entry>
Oct 25 16:53:48 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:53:48 user nova-compute[74048]:     </system>
Oct 25 16:53:48 user nova-compute[74048]:   </sysinfo>
Oct 25 16:53:48 user nova-compute[74048]:   <os>
Oct 25 16:53:48 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:53:48 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:53:48 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:53:48 user nova-compute[74048]:   </os>
Oct 25 16:53:48 user nova-compute[74048]:   <features>
Oct 25 16:53:48 user nova-compute[74048]:     <acpi/>
Oct 25 16:53:48 user nova-compute[74048]:     <apic/>
Oct 25 16:53:48 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:53:48 user nova-compute[74048]:   </features>
Oct 25 16:53:48 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:53:48 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:53:48 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:53:48 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:53:48 user nova-compute[74048]:   </clock>
Oct 25 16:53:48 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:53:48 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:53:48 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:53:48 user nova-compute[74048]:   </cpu>
Oct 25 16:53:48 user nova-compute[74048]:   <devices>
Oct 25 16:53:48 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:53:48 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:53:48 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk"/>
Oct 25 16:53:48 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:53:48 user nova-compute[74048]:     </disk>
Oct 25 16:53:48 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:53:48 user nova-compute[74048]:       <mac address="fa:16:3e:12:e0:ad"/>
Oct 25 16:53:48 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:53:48 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:53:48 user nova-compute[74048]:       <target dev="tapc84911a8-a9"/>
Oct 25 16:53:48 user nova-compute[74048]:     </interface>
Oct 25 16:53:48 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:53:48 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/console.log" append="off"/>
Oct 25 16:53:48 user nova-compute[74048]:     </serial>
Oct 25 16:53:48 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:53:48 user nova-compute[74048]:     <video>
Oct 25 16:53:48 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:53:48 user nova-compute[74048]:     </video>
Oct 25 16:53:48 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:53:48 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:53:48 user nova-compute[74048]:     </rng>
Oct 25 16:53:48 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:53:48 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:53:48 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:53:48 user nova-compute[74048]:     </memballoon>
Oct 25 16:53:48 user nova-compute[74048]:   </devices>
Oct 25 16:53:48 user nova-compute[74048]: </domain>
Oct 25 16:53:48 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1395469249',display_name='tempest-VolumesSnapshotTestJSON-instance-1395469249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1395469249',id=46,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvbhrr47tKmiTM44P3uKZPgOvTZMoxSsFYZKmNlw0JIkeujNvKGqh1WI8Paa6RxFWTt7MWXf1rDrNH8tTGjU2ace37uPOjLErOyOsC8ik0bXPPYb1peWGY5VwA1K/FyA==',key_name='tempest-keypair-11629835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a28c6406a21048bd88b6defdb0547fba',ramdisk_id='',reservation_id='r-zh60xake',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1876187338',owner_user_name='tempest-VolumesSnapshotTestJSON-1876187338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78ebbfe155248d28d49a46798eb5870',uuid=37f397bc-dbe3-4285-a4db-cb3205fe88c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converting VIF {"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG os_vif [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f701fbe-5fe7-5fa7-a052-a3644161eb5e', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc84911a8-a9, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc84911a8-a9, col_values=(('qos', UUID('f0eb770d-8989-49eb-adfb-12227bb82f92')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc84911a8-a9, col_values=(('external_ids', {'iface-id': 'c84911a8-a9b8-4332-bac3-a74108ba7273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:e0:ad', 'vm-uuid': '37f397bc-dbe3-4285-a4db-cb3205fe88c1'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:48 user nova-compute[74048]: INFO os_vif [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9')
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:53:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No VIF found with MAC fa:16:3e:12:e0:ad, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:53:49 user nova-compute[74048]: DEBUG nova.network.neutron [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updated VIF entry in instance network info cache for port c84911a8-a9b8-4332-bac3-a74108ba7273. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:53:49 user nova-compute[74048]: DEBUG nova.network.neutron [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updating instance_info_cache with network_info: [{"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:53:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e63ef89c-1b84-432b-b96d-39a9071f552e req-6c35775e-892a-41e3-affe-d30bf55c05e4 service nova] Releasing lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-dba9b1e2-2ee0-4db3-b1d5-5ac7507b4814 req-fe6dc514-f14d-4bfa-b96e-217094daf577 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dba9b1e2-2ee0-4db3-b1d5-5ac7507b4814 req-fe6dc514-f14d-4bfa-b96e-217094daf577 service nova] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dba9b1e2-2ee0-4db3-b1d5-5ac7507b4814 req-fe6dc514-f14d-4bfa-b96e-217094daf577 service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-dba9b1e2-2ee0-4db3-b1d5-5ac7507b4814 req-fe6dc514-f14d-4bfa-b96e-217094daf577 service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-dba9b1e2-2ee0-4db3-b1d5-5ac7507b4814 req-fe6dc514-f14d-4bfa-b96e-217094daf577 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] No waiting events found dispatching network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:50 user nova-compute[74048]: WARNING nova.compute.manager [req-dba9b1e2-2ee0-4db3-b1d5-5ac7507b4814 req-fe6dc514-f14d-4bfa-b96e-217094daf577 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received unexpected event network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 for instance with vm_state building and task_state spawning.
Oct 25 16:53:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:53:52 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Instance spawned successfully.
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-87561b7f-f061-4124-a568-cfee31838274 req-9141bdfb-bd45-40fd-adc2-c910e4bc7e5d service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87561b7f-f061-4124-a568-cfee31838274 req-9141bdfb-bd45-40fd-adc2-c910e4bc7e5d service nova] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87561b7f-f061-4124-a568-cfee31838274 req-9141bdfb-bd45-40fd-adc2-c910e4bc7e5d service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-87561b7f-f061-4124-a568-cfee31838274 req-9141bdfb-bd45-40fd-adc2-c910e4bc7e5d service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.compute.manager [req-87561b7f-f061-4124-a568-cfee31838274 req-9141bdfb-bd45-40fd-adc2-c910e4bc7e5d service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] No waiting events found dispatching network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:53:52 user nova-compute[74048]: WARNING nova.compute.manager [req-87561b7f-f061-4124-a568-cfee31838274 req-9141bdfb-bd45-40fd-adc2-c910e4bc7e5d service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received unexpected event network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 for instance with vm_state building and task_state spawning.
Oct 25 16:53:52 user nova-compute[74048]: INFO nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Took 6.07 seconds to spawn the instance on the hypervisor.
Oct 25 16:53:52 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:53:52 user nova-compute[74048]: INFO nova.compute.manager [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Took 6.96 seconds to build instance.
Oct 25 16:53:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1bbcb222-33ed-4308-a9a3-1c1b94459a1c tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.073s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:53 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:53 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:53:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:53:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:53:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:53:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:53:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:53:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:53:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8144MB free_disk=25.01541519165039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:53:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-changed-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Refreshing instance network info cache due to event network-changed-cba57bbe-a7a5-4d0f-981d-66bcd9d81974. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Refreshing network info cache for port cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 79b0e968-4730-4abd-b252-3f7d140b18d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated VIF entry in instance network info cache for port cba57bbe-a7a5-4d0f-981d-66bcd9d81974. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG nova.network.neutron [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f22ad483-506c-4bc3-ae81-5ae30bb16950 req-69c7711b-a955-4aa9-96a8-3a9eb746542e service nova] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:01 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:01 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:54:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:01 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating instance_info_cache with network_info: [{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-changed-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.compute.manager [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Refreshing instance network info cache due to event network-changed-63d164cb-be72-47b9-b2f2-caf7d3118679. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Refreshing network info cache for port 63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Stashing vm_state: active {{(pid=74048) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:54:02 user nova-compute[74048]: INFO nova.compute.claims [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Claim successful on node user
Oct 25 16:54:02 user nova-compute[74048]: INFO nova.compute.resource_tracker [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating resource usage from migration 40fe0bab-8ebb-4ffa-9de4-a08d30f2106c
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updated VIF entry in instance network info cache for port 63d164cb-be72-47b9-b2f2-caf7d3118679. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.network.neutron [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-1971296f-f5c3-4a8b-b09b-f0834356327d req-b396174b-4390-44c0-8816-8c07bea8248a service nova] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.393s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:02 user nova-compute[74048]: INFO nova.compute.manager [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Migrating
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG nova.network.neutron [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:54:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUeOQdXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:54:03 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:54:03 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:54:03 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8963fecd-99bf-4ca0-886f-4abdb35c1125]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:54:03 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c70a33a-1735-4736-a06c-2e65e855072b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7] added
Oct 25 16:54:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5c646-ed0e-499a-ba47-8dbea48e8e58]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e43cd8-b24d-4669-a3ae-e4536fbfd13b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUeOQdXK {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUeOQdXK" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabef49f-df72-43eb-992e-ef7cf9977379]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUeOQdXK'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716e809-6668-4bdd-938d-3d07e30de6d0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d0a735-7abd-47e2-937a-aab1caefc584]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b70968a-b7ad-45a0-970e-d5b999a61f07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260]
Oct 25 16:54:03 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260] successful.
Oct 25 16:54:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba1f5a4-2e70-468f-8d49-26977acafb92]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[22002259-2208-47a0-b13e-87c264e8d82d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:03 user nova-compute[74048]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:03 user nova-compute[74048]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:03 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b3def-e63b-4ef8-8ba9-bdb16bd99e34]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUeOQdXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Starting migrate_disk_and_power_off {{(pid=74048) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-unplugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-unplugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:54:04 user nova-compute[74048]: WARNING nova.compute.manager [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-unplugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state active and task_state resize_migrating.
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:54:04 user nova-compute[74048]: WARNING nova.compute.manager [req-4de12320-77dd-4c39-90ed-d3fe4e3c2f5b req-37d1209e-38dc-44c9-93d6-f8fcaae55e1a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state active and task_state resize_migrating.
Oct 25 16:54:04 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance destroyed successfully.
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:52:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-302978694',display_name='tempest-ServerActionsTestOtherA-server-302978694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-302978694',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-zkjnpk0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63d164cb-be, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d3e7999-8bce-4b0c-aa82-24ba8db176b5) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:04 user nova-compute[74048]: INFO os_vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be')
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:54:04 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23638303035663663', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638303035663663', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.165s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'flavor' on Instance uuid 79b0e968-4730-4abd-b252-3f7d140b18d1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9808b339-49f0-4951-8367-990649da35d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:54:04 user nova-compute[74048]: No targets found.
Oct 25 16:54:04 user nova-compute[74048]: iSNS:
Oct 25 16:54:04 user nova-compute[74048]: No targets found.
Oct 25 16:54:04 user nova-compute[74048]: STATIC:
Oct 25 16:54:04 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7
Oct 25 16:54:04 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:54:04 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:54:04 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:54:04 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:54:04 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:54:04 user nova-compute[74048]: FIRMWARE:
Oct 25 16:54:04 user nova-compute[74048]: No targets found.
Oct 25 16:54:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:54:04 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:54:04 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:54:04 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:54:04 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:54:04 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:54:04 user nova-compute[74048]:   <serial>98a68307-8bbd-4ebb-8bfc-2a3375625fb7</serial>
Oct 25 16:54:04 user nova-compute[74048]: </disk>
Oct 25 16:54:04 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b0d55-6ba5-4d40-b6fb-e926a489afe3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0926725-06f6-4ba9-8f8e-8e91f87f53c3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:04 user nova-compute[74048]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:04 user nova-compute[74048]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840203010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[adae7a54-8f7e-445b-a2a9-e35f9f626737]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68ea099-a98a-412b-a8b5-5a3c1b5e5a6f]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbe00e2-9963-4a98-a2d5-18102558d46a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c6ab07-c114-46ed-b628-68d54ba3d092]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ba132-d2b7-482c-9497-3356d1387619]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f910d5-4b89-4666-9356-5df3a4336f8e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]
Oct 25 16:54:04 user nova-compute[74048]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.
Oct 25 16:54:04 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[621266e1-2506-4e43-a366-8f21cda48365]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== disconnect_volume: return (526ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:54:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:54:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:54:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:54:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] No VIF found with MAC fa:16:3e:c2:47:d6, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:54:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3a7fac2c-19b9-4f2e-9a0e-bcdafd14508d tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.643s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Port 63d164cb-be72-47b9-b2f2-caf7d3118679 binding to destination host user is already ACTIVE {{(pid=74048) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:06 user nova-compute[74048]: INFO nova.compute.manager [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Detaching volume 98a68307-8bbd-4ebb-8bfc-2a3375625fb7
Oct 25 16:54:06 user nova-compute[74048]: INFO nova.virt.block_device [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Attempting to driver detach volume 98a68307-8bbd-4ebb-8bfc-2a3375625fb7 from mountpoint /dev/vdb
Oct 25 16:54:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Attempting to detach device vdb from instance 79b0e968-4730-4abd-b252-3f7d140b18d1 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:54:06 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:54:06 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:54:06 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:54:06 user nova-compute[74048]:   <serial>98a68307-8bbd-4ebb-8bfc-2a3375625fb7</serial>
Oct 25 16:54:06 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:54:06 user nova-compute[74048]: </disk>
Oct 25 16:54:06 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:54:06 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully detached device vdb from instance 79b0e968-4730-4abd-b252-3f7d140b18d1 from the persistent domain config.
Oct 25 16:54:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79b0e968-4730-4abd-b252-3f7d140b18d1 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:54:06 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:54:06 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:54:06 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:54:06 user nova-compute[74048]:   <serial>98a68307-8bbd-4ebb-8bfc-2a3375625fb7</serial>
Oct 25 16:54:06 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:54:06 user nova-compute[74048]: </disk>
Oct 25 16:54:06 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:54:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG nova.network.neutron [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG os_brick.utils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[451571b4-b333-4259-a1f5-2f23a11c8d30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[006eb761-bca2-43e0-8f6a-99d311de0495]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed9605-b62f-462d-98a2-301c2f45e79f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bfba3e-4aeb-4b4c-bdbe-b9cca5605641]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79b0e968-4730-4abd-b252-3f7d140b18d1 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:54:07 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:54:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b19616-ccb7-401d-8ead-46af170f0daa]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:54:07 user nova-compute[74048]: DEBUG os_brick.utils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:54:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Starting finish_migration {{(pid=74048) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance directory exists: not creating {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 16:54:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Creating image(s)
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Did not create local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Ensure instance console log exists: /opt/stack/data/nova/instances/8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Start _get_guest_xml network_info=[{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '92b4e74d-b0a4-405b-a6f4-fdc7144d9f9c', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e', 'attached_at': '2023-10-25T16:54:25.000000', 'detached_at': '', 'volume_id': '83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'serial': '83f10dfe-a4df-4f49-8800-4ae1e5cc9c47'}, 'volume_type': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:54:24 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:54:24 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:54:24 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:54:24 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:54:24 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50fc85-43b3-420a-9ead-cfbc4ae0701c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:54:24 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[479fe76b-a7ba-44df-ba8e-86de6fd846dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47] added
Oct 25 16:54:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f20529-a246-4f03-b6cc-3dc9b19cd2b0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73b2c1-f244-4118-ace3-86bc0042df5b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnKxqXDF {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnKxqXDF" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1772ce-21fa-4d48-b154-34a06d0fd2b0]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnKxqXDF'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f48242b-5a6b-46bd-8376-8aea15927a4d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2bfd4-1034-4287-82de-e42443fc47ff]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb02b1-8236-435f-9d26-4b0b6a55a95a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]
Oct 25 16:54:24 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.
Oct 25 16:54:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[11deb1d8-750b-4d74-a095-bd511d82b064]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0bc44-bda4-4097-8f57-546822e3c0e3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:24 user nova-compute[74048]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:24 user nova-compute[74048]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:24 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:54:24 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:25 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:25 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b27bb31-56df-4747-9a24-71cb74377888]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:25 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26637303266663332', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637303266663332', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:52:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-302978694',display_name='tempest-ServerActionsTestOtherA-server-302978694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-302978694',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-zkjnpk0l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:54:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:54:26 user nova-compute[74048]:   <uuid>8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e</uuid>
Oct 25 16:54:26 user nova-compute[74048]:   <name>instance-0000002c</name>
Oct 25 16:54:26 user nova-compute[74048]:   <memory>2097152</memory>
Oct 25 16:54:26 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:54:26 user nova-compute[74048]:   <metadata>
Oct 25 16:54:26 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:54:26 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:54:26 user nova-compute[74048]:       <nova:name>tempest-ServerActionsTestOtherA-server-302978694</nova:name>
Oct 25 16:54:26 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:54:24</nova:creationTime>
Oct 25 16:54:26 user nova-compute[74048]:       <nova:flavor name="m1.small">
Oct 25 16:54:26 user nova-compute[74048]:         <nova:memory>2048</nova:memory>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:disk>20</nova:disk>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:54:26 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:54:26 user nova-compute[74048]:       <nova:owner>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:user uuid="c809d630a78d4ce4bef9a9462543d2ad">tempest-ServerActionsTestOtherA-318048713-project-member</nova:user>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:project uuid="8ad2347aaae1424681b490608fde8b08">tempest-ServerActionsTestOtherA-318048713</nova:project>
Oct 25 16:54:26 user nova-compute[74048]:       </nova:owner>
Oct 25 16:54:26 user nova-compute[74048]:       <nova:ports>
Oct 25 16:54:26 user nova-compute[74048]:         <nova:port uuid="63d164cb-be72-47b9-b2f2-caf7d3118679">
Oct 25 16:54:26 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:54:26 user nova-compute[74048]:         </nova:port>
Oct 25 16:54:26 user nova-compute[74048]:       </nova:ports>
Oct 25 16:54:26 user nova-compute[74048]:     </nova:instance>
Oct 25 16:54:26 user nova-compute[74048]:   </metadata>
Oct 25 16:54:26 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:54:26 user nova-compute[74048]:     <system>
Oct 25 16:54:26 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:54:26 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:54:26 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:54:26 user nova-compute[74048]:       <entry name="serial">8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e</entry>
Oct 25 16:54:26 user nova-compute[74048]:       <entry name="uuid">8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e</entry>
Oct 25 16:54:26 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:54:26 user nova-compute[74048]:     </system>
Oct 25 16:54:26 user nova-compute[74048]:   </sysinfo>
Oct 25 16:54:26 user nova-compute[74048]:   <os>
Oct 25 16:54:26 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:54:26 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:54:26 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:54:26 user nova-compute[74048]:   </os>
Oct 25 16:54:26 user nova-compute[74048]:   <features>
Oct 25 16:54:26 user nova-compute[74048]:     <acpi/>
Oct 25 16:54:26 user nova-compute[74048]:     <apic/>
Oct 25 16:54:26 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:54:26 user nova-compute[74048]:   </features>
Oct 25 16:54:26 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:54:26 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:54:26 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:54:26 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:54:26 user nova-compute[74048]:   </clock>
Oct 25 16:54:26 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:54:26 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:54:26 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:54:26 user nova-compute[74048]:   </cpu>
Oct 25 16:54:26 user nova-compute[74048]:   <devices>
Oct 25 16:54:26 user nova-compute[74048]:     <disk type="block" device="disk">
Oct 25 16:54:26 user nova-compute[74048]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:54:26 user nova-compute[74048]:       <source dev="/dev/sdc"/>
Oct 25 16:54:26 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:54:26 user nova-compute[74048]:       <serial>83f10dfe-a4df-4f49-8800-4ae1e5cc9c47</serial>
Oct 25 16:54:26 user nova-compute[74048]:     </disk>
Oct 25 16:54:26 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:54:26 user nova-compute[74048]:       <mac address="fa:16:3e:48:0b:54"/>
Oct 25 16:54:26 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:54:26 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:54:26 user nova-compute[74048]:       <target dev="tap63d164cb-be"/>
Oct 25 16:54:26 user nova-compute[74048]:     </interface>
Oct 25 16:54:26 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:54:26 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e/console.log" append="off"/>
Oct 25 16:54:26 user nova-compute[74048]:     </serial>
Oct 25 16:54:26 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:54:26 user nova-compute[74048]:     <video>
Oct 25 16:54:26 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:54:26 user nova-compute[74048]:     </video>
Oct 25 16:54:26 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:54:26 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:54:26 user nova-compute[74048]:     </rng>
Oct 25 16:54:26 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:54:26 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:54:26 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:54:26 user nova-compute[74048]:     </memballoon>
Oct 25 16:54:26 user nova-compute[74048]:   </devices>
Oct 25 16:54:26 user nova-compute[74048]: </domain>
Oct 25 16:54:26 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:52:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-302978694',display_name='tempest-ServerActionsTestOtherA-server-302978694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-302978694',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:52:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-zkjnpk0l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:54:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85231717-network", "vif_mac": "fa:16:3e:48:0b:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG os_vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71d59fff-449b-5217-9883-4c27c2bf8d8c', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63d164cb-be, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63d164cb-be, col_values=(('qos', UUID('3fb35788-e928-456e-bae5-d1da8c49222b')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63d164cb-be, col_values=(('external_ids', {'iface-id': '63d164cb-be72-47b9-b2f2-caf7d3118679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0b:54', 'vm-uuid': '8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:26 user nova-compute[74048]: INFO os_vif [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be')
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:54:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] No VIF found with MAC fa:16:3e:48:0b:54, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:54:27 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79b0e968-4730-4abd-b252-3f7d140b18d1 is timed out.
Oct 25 16:54:27 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully detached device vdb from instance 79b0e968-4730-4abd-b252-3f7d140b18d1 from the live domain config.
Oct 25 16:54:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUeOQdXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:54:27 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bf82ad-f39d-4607-ae14-306aa4009d9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:54:27 user nova-compute[74048]: No targets found.
Oct 25 16:54:27 user nova-compute[74048]: iSNS:
Oct 25 16:54:27 user nova-compute[74048]: No targets found.
Oct 25 16:54:27 user nova-compute[74048]: STATIC:
Oct 25 16:54:27 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7
Oct 25 16:54:27 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:54:27 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:54:27 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:54:27 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:54:27 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:54:27 user nova-compute[74048]: FIRMWARE:
Oct 25 16:54:27 user nova-compute[74048]: No targets found.
Oct 25 16:54:27 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:54:27 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:54:27 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6051f948-9339-47c5-9f7e-abe9fa7fe698]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b094449-45a4-4671-94f6-a5f7332dd430]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:27 user nova-compute[74048]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:27 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 (non-flash)
Oct 25 16:54:27 user nova-compute[74048]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:54:27 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18402009d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[614cb40c-b93d-4215-9a37-5560bb5a4405]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a6f656-dde1-45b3-88eb-5577d328e4f2]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e186f2-f836-460d-8304-866acbe443bd]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52b9a34-da92-4f41-9f0e-d70588b85255]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e9cf7-c994-447e-ba5b-78ef1f73d02c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b82d43-eb22-404d-8071-7de221118f10]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260]
Oct 25 16:54:27 user nova-compute[74048]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7, portal: 172.16.0.220,3260] successful.
Oct 25 16:54:27 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-726e6873-3930-421a-8539-5d1d2480c6bb req-985b1fe5-7b34-4e89-b392-62eff4fe454d service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-726e6873-3930-421a-8539-5d1d2480c6bb req-985b1fe5-7b34-4e89-b392-62eff4fe454d service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-726e6873-3930-421a-8539-5d1d2480c6bb req-985b1fe5-7b34-4e89-b392-62eff4fe454d service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-726e6873-3930-421a-8539-5d1d2480c6bb req-985b1fe5-7b34-4e89-b392-62eff4fe454d service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG nova.compute.manager [req-726e6873-3930-421a-8539-5d1d2480c6bb req-985b1fe5-7b34-4e89-b392-62eff4fe454d service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:54:27 user nova-compute[74048]: WARNING nova.compute.manager [req-726e6873-3930-421a-8539-5d1d2480c6bb req-985b1fe5-7b34-4e89-b392-62eff4fe454d service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state active and task_state resize_finish.
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a68307-8bbd-4ebb-8bfc-2a3375625fb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[68482227-3389-4771-b399-ee4268e8e3f8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] <== disconnect_volume: return (342ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:28 user nova-compute[74048]: DEBUG nova.objects.instance [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'flavor' on Instance uuid 79b0e968-4730-4abd-b252-3f7d140b18d1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:28 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-581de452-2694-4fb6-8cc3-d2eb2a3bf3df tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.926s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:54:29 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance running successfully.
Oct 25 16:54:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Failed to set time: agent not configured {{(pid=74048) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-41fc13eb-e41c-41d4-a19e-44547b97a11c tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] finish_migration finished successfully. {{(pid=74048) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-15d4ad66-e09a-4ebd-963d-419353121f60 req-9a9b0208-4ee7-4b2c-8eaa-91900cab52b5 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-15d4ad66-e09a-4ebd-963d-419353121f60 req-9a9b0208-4ee7-4b2c-8eaa-91900cab52b5 service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-15d4ad66-e09a-4ebd-963d-419353121f60 req-9a9b0208-4ee7-4b2c-8eaa-91900cab52b5 service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-15d4ad66-e09a-4ebd-963d-419353121f60 req-9a9b0208-4ee7-4b2c-8eaa-91900cab52b5 service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:29 user nova-compute[74048]: DEBUG nova.compute.manager [req-15d4ad66-e09a-4ebd-963d-419353121f60 req-9a9b0208-4ee7-4b2c-8eaa-91900cab52b5 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:54:29 user nova-compute[74048]: WARNING nova.compute.manager [req-15d4ad66-e09a-4ebd-963d-419353121f60 req-9a9b0208-4ee7-4b2c-8eaa-91900cab52b5 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state active and task_state resize_finish.
Oct 25 16:54:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'info_cache' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.network.neutron [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:56 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance destroyed successfully.
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'resources' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG os_vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3c8049b-bd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=078f7c3c-e72c-4d7d-b100-56aebcac8bcb) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:56 user nova-compute[74048]: INFO os_vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd')
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start _get_guest_xml network_info=[{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'numa_topology' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:54:56 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'vcpu_model' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'pci_devices' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:54:56 user nova-compute[74048]:   <uuid>063fb985-6780-4196-90b6-dc92ab263244</uuid>
Oct 25 16:54:56 user nova-compute[74048]:   <name>instance-00000026</name>
Oct 25 16:54:56 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:54:56 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:54:56 user nova-compute[74048]:   <metadata>
Oct 25 16:54:56 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:54:56 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:54:56 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeTestJSON-server-789838502</nova:name>
Oct 25 16:54:56 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:54:56</nova:creationTime>
Oct 25 16:54:56 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:54:56 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:54:56 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:54:56 user nova-compute[74048]:       <nova:owner>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:user uuid="5010a1f24ffe411f849b0917ee40d17b">tempest-AttachVolumeTestJSON-251204741-project-member</nova:user>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:project uuid="4a9cc47d22fc44f9babc2ec69f539e77">tempest-AttachVolumeTestJSON-251204741</nova:project>
Oct 25 16:54:56 user nova-compute[74048]:       </nova:owner>
Oct 25 16:54:56 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:54:56 user nova-compute[74048]:       <nova:ports>
Oct 25 16:54:56 user nova-compute[74048]:         <nova:port uuid="d3c8049b-bdc5-494f-aa5f-036fb3218564">
Oct 25 16:54:56 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 16:54:56 user nova-compute[74048]:         </nova:port>
Oct 25 16:54:56 user nova-compute[74048]:       </nova:ports>
Oct 25 16:54:56 user nova-compute[74048]:     </nova:instance>
Oct 25 16:54:56 user nova-compute[74048]:   </metadata>
Oct 25 16:54:56 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:54:56 user nova-compute[74048]:     <system>
Oct 25 16:54:56 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:54:56 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:54:56 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:54:56 user nova-compute[74048]:       <entry name="serial">063fb985-6780-4196-90b6-dc92ab263244</entry>
Oct 25 16:54:56 user nova-compute[74048]:       <entry name="uuid">063fb985-6780-4196-90b6-dc92ab263244</entry>
Oct 25 16:54:56 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:54:56 user nova-compute[74048]:     </system>
Oct 25 16:54:56 user nova-compute[74048]:   </sysinfo>
Oct 25 16:54:56 user nova-compute[74048]:   <os>
Oct 25 16:54:56 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:54:56 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:54:56 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:54:56 user nova-compute[74048]:   </os>
Oct 25 16:54:56 user nova-compute[74048]:   <features>
Oct 25 16:54:56 user nova-compute[74048]:     <acpi/>
Oct 25 16:54:56 user nova-compute[74048]:     <apic/>
Oct 25 16:54:56 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:54:56 user nova-compute[74048]:   </features>
Oct 25 16:54:56 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:54:56 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:54:56 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:54:56 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:54:56 user nova-compute[74048]:   </clock>
Oct 25 16:54:56 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:54:56 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:54:56 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:54:56 user nova-compute[74048]:   </cpu>
Oct 25 16:54:56 user nova-compute[74048]:   <devices>
Oct 25 16:54:56 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:54:56 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:54:56 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk"/>
Oct 25 16:54:56 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:54:56 user nova-compute[74048]:     </disk>
Oct 25 16:54:56 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:54:56 user nova-compute[74048]:       <mac address="fa:16:3e:54:94:ad"/>
Oct 25 16:54:56 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:54:56 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:54:56 user nova-compute[74048]:       <target dev="tapd3c8049b-bd"/>
Oct 25 16:54:56 user nova-compute[74048]:     </interface>
Oct 25 16:54:56 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:54:56 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/console.log" append="off"/>
Oct 25 16:54:56 user nova-compute[74048]:     </serial>
Oct 25 16:54:56 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:54:56 user nova-compute[74048]:     <video>
Oct 25 16:54:56 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:54:56 user nova-compute[74048]:     </video>
Oct 25 16:54:56 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:54:56 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:54:56 user nova-compute[74048]:     </rng>
Oct 25 16:54:56 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:54:56 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:54:56 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:54:56 user nova-compute[74048]:     </memballoon>
Oct 25 16:54:56 user nova-compute[74048]:   </devices>
Oct 25 16:54:56 user nova-compute[74048]: </domain>
Oct 25 16:54:56 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'trusted_certs' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:56 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Cannot resize image /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'migration_context' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.objects.base [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Object Instance<063fb985-6780-4196-90b6-dc92ab263244> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG os_vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec594c7c-16f3-5ad1-beea-db9f60578006', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3c8049b-bd, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3c8049b-bd, col_values=(('qos', UUID('78d5bded-35fa-4697-bde7-99f7f322b4b4')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3c8049b-bd, col_values=(('external_ids', {'iface-id': 'd3c8049b-bdc5-494f-aa5f-036fb3218564', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:94:ad', 'vm-uuid': '063fb985-6780-4196-90b6-dc92ab263244'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: INFO os_vif [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd')
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-changed-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Refreshing instance network info cache due to event network-changed-7320273c-b4ff-4c16-bf72-c01547e92972. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] Acquiring lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] Acquired lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.network.neutron [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Refreshing network info cache for port 7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:57 user nova-compute[74048]: INFO nova.compute.manager [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Terminating instance
Oct 25 16:54:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-ee819dac-9f26-4b19-bd6c-6b7e554884e6 req-b2bfb499-d565-4511-a3d1-be376c446502 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-vif-unplugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ee819dac-9f26-4b19-bd6c-6b7e554884e6 req-b2bfb499-d565-4511-a3d1-be376c446502 service nova] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ee819dac-9f26-4b19-bd6c-6b7e554884e6 req-b2bfb499-d565-4511-a3d1-be376c446502 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ee819dac-9f26-4b19-bd6c-6b7e554884e6 req-b2bfb499-d565-4511-a3d1-be376c446502 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-ee819dac-9f26-4b19-bd6c-6b7e554884e6 req-b2bfb499-d565-4511-a3d1-be376c446502 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] No waiting events found dispatching network-vif-unplugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-ee819dac-9f26-4b19-bd6c-6b7e554884e6 req-b2bfb499-d565-4511-a3d1-be376c446502 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-vif-unplugged-7320273c-b4ff-4c16-bf72-c01547e92972 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.network.neutron [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updated VIF entry in instance network info cache for port 7320273c-b4ff-4c16-bf72-c01547e92972. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.network.neutron [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating instance_info_cache with network_info: [{"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-383de737-ce90-44da-bca9-a3a992c47248 req-fa47dfe3-900e-4f1e-9abf-7475948e6c62 service nova] Releasing lock "refresh_cache-79b0e968-4730-4abd-b252-3f7d140b18d1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Instance destroyed successfully.
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'resources' on Instance uuid 79b0e968-4730-4abd-b252-3f7d140b18d1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1249359891',display_name='tempest-TestStampPattern-server-1249359891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1249359891',id=43,image_ref='21439d94-30f7-4f94-9eba-3e1a11063533',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY/XNxT3bZdfbS7bA8TEGYcJcrnDZXILC+YdYHyiQNZqB7M8VNeazxYLUF69qWftbyUFlAVIUHgkPt223heRLbEHqBn6l2ugX2Ts6mv/TBI7i/pV0nvB9213qET7Ai/mA==',key_name='tempest-TestStampPattern-1069318120',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:51:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e8acd0141444fa2ae4dd9f49267715a',ramdisk_id='',reservation_id='r-r6w4aiv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='35db9646-f68d-4180-94cd-9cce20c0756f',image_min_disk='1',image_min_ram='0',image_owner_id='8e8acd0141444fa2ae4dd9f49267715a',image_owner_project_name='tempest-TestStampPattern-1148836256',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1148836256-project-member',image_user_id='ebdff923d6304b37880ae8bd217f2f3a',owner_project_name='tempest-TestStampPattern-1148836256',owner_user_name='tempest-TestStampPattern-1148836256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:51:59Z,user_data=None,user_id='ebdff923d6304b37880ae8bd217f2f3a',uuid=79b0e968-4730-4abd-b252-3f7d140b18d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converting VIF {"id": "7320273c-b4ff-4c16-bf72-c01547e92972", "address": "fa:16:3e:c2:47:d6", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320273c-b4", "ovs_interfaceid": "7320273c-b4ff-4c16-bf72-c01547e92972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG os_vif [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7320273c-b4, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=270a74bd-4023-43cb-89e8-134594aa3509) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:54:58 user nova-compute[74048]: INFO os_vif [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:47:d6,bridge_name='br-int',has_traffic_filtering=True,id=7320273c-b4ff-4c16-bf72-c01547e92972,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320273c-b4')
Oct 25 16:54:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Deleting instance files /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1_del
Oct 25 16:54:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Deletion of /opt/stack/data/nova/instances/79b0e968-4730-4abd-b252-3f7d140b18d1_del complete
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:58 user nova-compute[74048]: INFO nova.compute.manager [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Took 1.47 seconds to destroy the instance on the hypervisor.
Oct 25 16:54:58 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:54:58 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c0587fa-df62-4b81-94ca-27e9f18e7323 req-2e73c18c-a11d-451f-958e-5bd3f6c70a07 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c0587fa-df62-4b81-94ca-27e9f18e7323 req-2e73c18c-a11d-451f-958e-5bd3f6c70a07 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c0587fa-df62-4b81-94ca-27e9f18e7323 req-2e73c18c-a11d-451f-958e-5bd3f6c70a07 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8c0587fa-df62-4b81-94ca-27e9f18e7323 req-2e73c18c-a11d-451f-958e-5bd3f6c70a07 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-8c0587fa-df62-4b81-94ca-27e9f18e7323 req-2e73c18c-a11d-451f-958e-5bd3f6c70a07 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:54:59 user nova-compute[74048]: WARNING nova.compute.manager [req-8c0587fa-df62-4b81-94ca-27e9f18e7323 req-2e73c18c-a11d-451f-958e-5bd3f6c70a07 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state stopped and task_state powering-on.
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-5510b8cf-5381-4611-9b9e-f5800d9e3ac0 req-d7870659-ef9b-413d-8fe9-93e352f5785e service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-vif-deleted-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:54:59 user nova-compute[74048]: INFO nova.compute.manager [req-5510b8cf-5381-4611-9b9e-f5800d9e3ac0 req-d7870659-ef9b-413d-8fe9-93e352f5785e service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Neutron deleted interface 7320273c-b4ff-4c16-bf72-c01547e92972; detaching it from the instance and deleting it from the info cache
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.network.neutron [req-5510b8cf-5381-4611-9b9e-f5800d9e3ac0 req-d7870659-ef9b-413d-8fe9-93e352f5785e service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:54:59 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8109MB free_disk=24.98430633544922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-5510b8cf-5381-4611-9b9e-f5800d9e3ac0 req-d7870659-ef9b-413d-8fe9-93e352f5785e service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Detach interface failed, port_id=7320273c-b4ff-4c16-bf72-c01547e92972, reason: Instance 79b0e968-4730-4abd-b252-3f7d140b18d1 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:54:59 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Took 0.85 seconds to deallocate network for instance.
Oct 25 16:54:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Applying migration context for instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e as it has an incoming, in-progress migration 40fe0bab-8ebb-4ffa-9de4-a08d30f2106c. Migration status is finished {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 16:54:59 user nova-compute[74048]: INFO nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating resource usage from migration 40fe0bab-8ebb-4ffa-9de4-a08d30f2106c
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 79b0e968-4730-4abd-b252-3f7d140b18d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Migration 40fe0bab-8ebb-4ffa-9de4-a08d30f2106c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:54:59 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-7da00159-a704-4f03-b8ce-e531b9b9d5e0 req-878d9f3b-85b0-4dd4-9e8a-e68b449c05d3 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received event network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7da00159-a704-4f03-b8ce-e531b9b9d5e0 req-878d9f3b-85b0-4dd4-9e8a-e68b449c05d3 service nova] Acquiring lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7da00159-a704-4f03-b8ce-e531b9b9d5e0 req-878d9f3b-85b0-4dd4-9e8a-e68b449c05d3 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7da00159-a704-4f03-b8ce-e531b9b9d5e0 req-878d9f3b-85b0-4dd4-9e8a-e68b449c05d3 service nova] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.manager [req-7da00159-a704-4f03-b8ce-e531b9b9d5e0 req-878d9f3b-85b0-4dd4-9e8a-e68b449c05d3 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] No waiting events found dispatching network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:55:00 user nova-compute[74048]: WARNING nova.compute.manager [req-7da00159-a704-4f03-b8ce-e531b9b9d5e0 req-878d9f3b-85b0-4dd4-9e8a-e68b449c05d3 service nova] [instance: 79b0e968-4730-4abd-b252-3f7d140b18d1] Received unexpected event network-vif-plugged-7320273c-b4ff-4c16-bf72-c01547e92972 for instance with vm_state deleted and task_state None.
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.333s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:00 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Deleted allocations for instance 79b0e968-4730-4abd-b252-3f7d140b18d1
Oct 25 16:55:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e417e434-df2b-4097-b0d9-49915931eadb tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "79b0e968-4730-4abd-b252-3f7d140b18d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.146s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:55:00 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance rebooted successfully.
Oct 25 16:55:00 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a217a987-7667-4ca9-8667-ab9772a9e534 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:55:01 user nova-compute[74048]: DEBUG nova.compute.manager [req-44225010-d081-41cf-a40c-777f3a1f977e req-d58ffb31-d9c7-488e-8309-ea26905428a0 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:55:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44225010-d081-41cf-a40c-777f3a1f977e req-d58ffb31-d9c7-488e-8309-ea26905428a0 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44225010-d081-41cf-a40c-777f3a1f977e req-d58ffb31-d9c7-488e-8309-ea26905428a0 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-44225010-d081-41cf-a40c-777f3a1f977e req-d58ffb31-d9c7-488e-8309-ea26905428a0 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:01 user nova-compute[74048]: DEBUG nova.compute.manager [req-44225010-d081-41cf-a40c-777f3a1f977e req-d58ffb31-d9c7-488e-8309-ea26905428a0 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:55:01 user nova-compute[74048]: WARNING nova.compute.manager [req-44225010-d081-41cf-a40c-777f3a1f977e req-d58ffb31-d9c7-488e-8309-ea26905428a0 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state active and task_state None.
Oct 25 16:55:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [{"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-changed-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:55:04 user nova-compute[74048]: DEBUG nova.compute.manager [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Refreshing instance network info cache due to event network-changed-d511c524-6a09-41bf-ab73-4dc476971275. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:55:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] Acquiring lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:55:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] Acquired lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:55:04 user nova-compute[74048]: DEBUG nova.network.neutron [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Refreshing network info cache for port d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:55:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updated VIF entry in instance network info cache for port d511c524-6a09-41bf-ab73-4dc476971275. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:55:05 user nova-compute[74048]: DEBUG nova.network.neutron [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating instance_info_cache with network_info: [{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:55:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-660d3ba0-ebd9-414b-afe8-ed25a62a21c0 req-d593bb59-1f25-4d72-bee7-38c23763f41d service nova] Releasing lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:55:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:11 user nova-compute[74048]: INFO nova.compute.manager [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attaching volume 74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 to /dev/vdb
Oct 25 16:55:11 user nova-compute[74048]: DEBUG os_brick.utils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a6f6b-a2e3-47d3-801e-b7a56ac602ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fff251-118b-4fd4-a78d-262ce56d7a94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbfde13-ea6b-4eb9-a3fd-11c4cb935c8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b45498b-ad43-43e1-8360-bb2d1644c680]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:55:11 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:55:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e854a4-6c4b-4593-aec5-ec62d90fdaac]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG os_brick.utils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:55:11 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating existing volume attachment record: a99931e1-354f-45fd-ba03-18813a092c4b {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:55:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCLVWhBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:55:29 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:55:29 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:55:29 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5038559-23d3-4172-b366-17e0598b4be9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:55:29 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58f9450-2dcd-4083-b8c1-1fc1bcf69fd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1] added
Oct 25 16:55:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2ca01-901e-4f37-8d9b-98b08813ea93]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce92cef-a116-4ced-89ba-a77143826432]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCLVWhBu {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCLVWhBu" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d1356-d43d-475b-aefc-0fb082dca9b9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCLVWhBu'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[80556aa2-397e-4e85-90bf-784042a2836b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d4f17-05eb-4e18-b59e-a1178ce3833f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:55:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:55:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8995edc1-e182-4a38-8a7c-b62a1862c6c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260]
Oct 25 16:55:29 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260] successful.
Oct 25 16:55:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba57847-6e1f-464a-b158-e27f77323692]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d182a85-2596-424e-9ca3-b070e9e5f1cf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:55:29 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:55:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:55:29 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:55:29 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375ca4c-efc6-4de6-9184-0c4879decafe]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:29 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCLVWhBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23566376566336166', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566376566336166', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG nova.objects.instance [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:55:30 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:55:30 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:55:30 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:55:30 user nova-compute[74048]:   <serial>74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1</serial>
Oct 25 16:55:30 user nova-compute[74048]: </disk>
Oct 25 16:55:30 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:55:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No VIF found with MAC fa:16:3e:a7:b2:ce, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:55:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-51fae95a-8f07-416c-86d7-2f1672a482d7 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.607s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-changed-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:55:36 user nova-compute[74048]: DEBUG nova.compute.manager [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Refreshing instance network info cache due to event network-changed-c84911a8-a9b8-4332-bac3-a74108ba7273. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:55:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] Acquiring lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:55:36 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] Acquired lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:55:36 user nova-compute[74048]: DEBUG nova.network.neutron [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Refreshing network info cache for port c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG nova.objects.instance [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'flavor' on Instance uuid 37f397bc-dbe3-4285-a4db-cb3205fe88c1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:55:37 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Ignoring supplied device name: /dev/vdb
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:37 user nova-compute[74048]: INFO nova.compute.manager [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Attaching volume 9203dd84-e82e-4e7a-bb35-25bb0c719396 to /dev/vdb
Oct 25 16:55:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updated VIF entry in instance network info cache for port c84911a8-a9b8-4332-bac3-a74108ba7273. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG nova.network.neutron [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updating instance_info_cache with network_info: [{"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-96f2f948-b428-4d19-9a54-b707d8331def req-a0883c08-02e6-41f7-bbc2-325514f4faf7 service nova] Releasing lock "refresh_cache-37f397bc-dbe3-4285-a4db-cb3205fe88c1" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG os_brick.utils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[38156f3d-cf88-4679-b3c7-3b82ceaa9137]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a9663f-9260-499b-8ecb-05d51046a3eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9488ac-c406-46fa-aed9-ed04be650d90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f63be4e-e392-4cd8-94c7-634391d22047]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:55:37 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:55:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc23f918-c758-4ef9-8951-97c55aec8a53]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG os_brick.utils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:55:37 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updating existing volume attachment record: ce14a6a7-2e74-41ec-8b53-298c1d113ef9 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:55:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Going to confirm migration 2 {{(pid=74048) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:55:51 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'info_cache' on Instance uuid 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG nova.network.neutron [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG nova.objects.instance [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'migration_context' on Instance uuid 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG nova.objects.base [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Object Instance<8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e> lazy-loaded attributes: info_cache,migration_context {{(pid=74048) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:55:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.331s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:52 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Deleted allocation for migration 40fe0bab-8ebb-4ffa-9de4-a08d30f2106c
Oct 25 16:55:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-e5603a2b-fc40-4088-b6ad-9bc1eaaf08d4 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.448s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:55:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:55:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:55:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:55:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:55:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:55:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:55:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:55:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:55:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:55:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:55:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:55:58 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:55:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:56:01 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:56:01 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8186MB free_disk=25.07198715209961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 063fb985-6780-4196-90b6-dc92ab263244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 35db9646-f68d-4180-94cd-9cce20c0756f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:56:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [{"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-063fb985-6780-4196-90b6-dc92ab263244" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 16:56:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:05 user nova-compute[74048]: INFO nova.compute.manager [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Detaching volume 74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1
Oct 25 16:56:05 user nova-compute[74048]: INFO nova.virt.block_device [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attempting to driver detach volume 74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 from mountpoint /dev/vdb
Oct 25 16:56:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Attempting to detach device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:56:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:56:05 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:56:05 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:56:05 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:56:05 user nova-compute[74048]:   <serial>74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1</serial>
Oct 25 16:56:05 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:56:05 user nova-compute[74048]: </disk>
Oct 25 16:56:05 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:56:06 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config.
Oct 25 16:56:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:56:06 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:56:06 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:56:06 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:56:06 user nova-compute[74048]:   <serial>74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1</serial>
Oct 25 16:56:06 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:56:06 user nova-compute[74048]: </disk>
Oct 25 16:56:06 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXHzYvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:56:06 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:56:06 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:56:06 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e318c4d-eb52-4a15-a514-b0593bcdabcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:56:06 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d477e-8a03-40ce-9208-d955e6fc6b91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396] added
Oct 25 16:56:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6806821c-1ba8-49d8-8de4-a9c4c61fac14]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17099229-f499-4e55-a085-5ac68458999e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfXHzYvJ {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfXHzYvJ" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ecee6-7277-4967-a2a6-6ca850aa7f56]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfXHzYvJ'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[060fa456-65e6-459f-bd2a-f84ead277204]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9d0b7c-83c9-4247-9321-9e8ae676aa52]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7693896-95e5-4cdb-8e78-0387c3688fcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260]
Oct 25 16:56:06 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260] successful.
Oct 25 16:56:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef74041e-2dec-471a-a139-c18e8fe74025]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e317ef-f695-4131-be21-c7669f512e79]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:56:06 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[669b5c47-ca0f-450e-ae14-da3dae5a02cb]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXHzYvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:56:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26462346263353035', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462346263353035', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG nova.objects.instance [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'flavor' on Instance uuid 37f397bc-dbe3-4285-a4db-cb3205fe88c1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:56:07 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:56:07 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 16:56:07 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:56:07 user nova-compute[74048]:   <serial>9203dd84-e82e-4e7a-bb35-25bb0c719396</serial>
Oct 25 16:56:07 user nova-compute[74048]: </disk>
Oct 25 16:56:07 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:56:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No VIF found with MAC fa:16:3e:12:e0:ad, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:56:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-000f501c-201e-47dc-8ee9-e12a526c52cb tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.607s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:08 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-changed-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG nova.compute.manager [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Refreshing instance network info cache due to event network-changed-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] Acquiring lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] Acquired lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG nova.network.neutron [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Refreshing network info cache for port f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:09 user nova-compute[74048]: INFO nova.compute.manager [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Terminating instance
Oct 25 16:56:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-4dfa96d3-b245-408a-8cfb-5ed791fa478e req-1ba3e5fb-ca8a-467f-8e18-8dff5adb615f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-vif-unplugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4dfa96d3-b245-408a-8cfb-5ed791fa478e req-1ba3e5fb-ca8a-467f-8e18-8dff5adb615f service nova] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4dfa96d3-b245-408a-8cfb-5ed791fa478e req-1ba3e5fb-ca8a-467f-8e18-8dff5adb615f service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4dfa96d3-b245-408a-8cfb-5ed791fa478e req-1ba3e5fb-ca8a-467f-8e18-8dff5adb615f service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-4dfa96d3-b245-408a-8cfb-5ed791fa478e req-1ba3e5fb-ca8a-467f-8e18-8dff5adb615f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] No waiting events found dispatching network-vif-unplugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-4dfa96d3-b245-408a-8cfb-5ed791fa478e req-1ba3e5fb-ca8a-467f-8e18-8dff5adb615f service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-vif-unplugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updated VIF entry in instance network info cache for port f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating instance_info_cache with network_info: [{"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b41378c2-df7c-43d2-a741-17ed3694ce5e req-eb141020-35de-4c69-aaed-78f41fc79691 service nova] Releasing lock "refresh_cache-35db9646-f68d-4180-94cd-9cce20c0756f" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:56:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Instance destroyed successfully.
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.objects.instance [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lazy-loading 'resources' on Instance uuid 35db9646-f68d-4180-94cd-9cce20c0756f {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-944157057',display_name='tempest-TestStampPattern-server-944157057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-944157057',id=41,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY/XNxT3bZdfbS7bA8TEGYcJcrnDZXILC+YdYHyiQNZqB7M8VNeazxYLUF69qWftbyUFlAVIUHgkPt223heRLbEHqBn6l2ugX2Ts6mv/TBI7i/pV0nvB9213qET7Ai/mA==',key_name='tempest-TestStampPattern-1069318120',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e8acd0141444fa2ae4dd9f49267715a',ramdisk_id='',reservation_id='r-1z5p08p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1148836256',owner_user_name='tempest-TestStampPattern-1148836256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:51:49Z,user_data=None,user_id='ebdff923d6304b37880ae8bd217f2f3a',uuid=35db9646-f68d-4180-94cd-9cce20c0756f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converting VIF {"id": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "address": "fa:16:3e:5e:10:02", "network": {"id": "85b3b9c4-ee42-4bef-af2f-95f90be67e0a", "bridge": "br-int", "label": "tempest-TestStampPattern-839710454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e8acd0141444fa2ae4dd9f49267715a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2bb69-1c", "ovs_interfaceid": "f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG os_vif [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f2bb69-1c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54262b10-91c5-4586-85e9-3b2b38ca2c0d) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:10 user nova-compute[74048]: INFO os_vif [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:10:02,bridge_name='br-int',has_traffic_filtering=True,id=f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd,network=Network(85b3b9c4-ee42-4bef-af2f-95f90be67e0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2bb69-1c')
Oct 25 16:56:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Deleting instance files /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f_del
Oct 25 16:56:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Deletion of /opt/stack/data/nova/instances/35db9646-f68d-4180-94cd-9cce20c0756f_del complete
Oct 25 16:56:10 user nova-compute[74048]: INFO nova.compute.manager [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 25 16:56:10 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:56:10 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:56:11 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:56:11 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Took 0.58 seconds to deallocate network for instance.
Oct 25 16:56:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:11 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:56:11 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:56:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:11 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Deleted allocations for instance 35db9646-f68d-4180-94cd-9cce20c0756f
Oct 25 16:56:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-1b8e5a95-ecdc-47f3-bc48-d77585716529 tempest-TestStampPattern-1148836256 tempest-TestStampPattern-1148836256-project-member] Lock "35db9646-f68d-4180-94cd-9cce20c0756f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] Acquiring lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] Lock "35db9646-f68d-4180-94cd-9cce20c0756f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] No waiting events found dispatching network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:56:12 user nova-compute[74048]: WARNING nova.compute.manager [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received unexpected event network-vif-plugged-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd for instance with vm_state deleted and task_state None.
Oct 25 16:56:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-a7c115a3-f91c-4ecf-a2e5-80ed80b37ec2 req-4efb57d4-f061-4d2e-b6a7-81388d55b88d service nova] [instance: 35db9646-f68d-4180-94cd-9cce20c0756f] Received event network-vif-deleted-f0f2bb69-1cff-4def-9cc9-bb17a0d92fbd {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:56:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:56:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:56:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:26 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab is timed out.
Oct 25 16:56:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config.
Oct 25 16:56:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCLVWhBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:56:26 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e0aa4-3155-4d29-937c-76d8a6adb9cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:56:26 user nova-compute[74048]: No targets found.
Oct 25 16:56:26 user nova-compute[74048]: iSNS:
Oct 25 16:56:26 user nova-compute[74048]: No targets found.
Oct 25 16:56:26 user nova-compute[74048]: STATIC:
Oct 25 16:56:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1
Oct 25 16:56:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:56:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:56:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396
Oct 25 16:56:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:56:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:56:26 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:56:26 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:56:26 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:56:26 user nova-compute[74048]: FIRMWARE:
Oct 25 16:56:26 user nova-compute[74048]: No targets found.
Oct 25 16:56:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:56:26 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:56:26 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52348b2-63da-40a0-8a47-325c809b7ed2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd75e69d-2bef-4fbd-978a-54759e3c8651]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:56:26 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:56:26 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:56:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:56:26 user nova-compute[74048]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 (non-flash)
Oct 25 16:56:26 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:56:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840587eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[936457e1-9eff-4ac4-b97b-f94eb5d2d551]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff288f9-b617-49c1-a708-5ac0e067a2a3]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ea368d-4a79-4196-bff7-afcb88f00594]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[35735614-ddc0-431c-9a01-290c7e599a60]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6101d164-9387-487e-94ac-4a94e572521c]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881de62-38a5-43d2-8e97-c1d2b2b440bb]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260]
Oct 25 16:56:26 user nova-compute[74048]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1, portal: 172.16.0.220,3260] successful.
Oct 25 16:56:26 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74be43ee-b8e2-4ca7-8dc4-1ef81d111ce1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c86ef-775a-4aff-8ddf-70e206a5977b]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== disconnect_volume: return (310ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:56:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:56:27 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:56:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9e5912fd-8c6d-455a-8ca7-f36e256f7d97 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:56:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:56:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:56:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:47 user nova-compute[74048]: INFO nova.compute.manager [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Terminating instance
Oct 25 16:56:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:47 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Instance destroyed successfully.
Oct 25 16:56:47 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'resources' on Instance uuid 063fb985-6780-4196-90b6-dc92ab263244 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-789838502',display_name='tempest-AttachVolumeTestJSON-server-789838502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-789838502',id=38,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpW99OpHQA2Yck8TmboQrd5Kwxk2a7i8VcI9IbzkbsvMzycY9lqbeUhLDh0qNy0RzA3e00+c2jkhvVqooNRpTvzo80pDqufD8ufGvIdyFD3mXcvyVp1nejquN8m+AE79A==',key_name='tempest-keypair-965709952',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-v5xw3389',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=063fb985-6780-4196-90b6-dc92ab263244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "address": "fa:16:3e:54:94:ad", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c8049b-bd", "ovs_interfaceid": "d3c8049b-bdc5-494f-aa5f-036fb3218564", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG os_vif [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3c8049b-bd, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78d5bded-35fa-4697-bde7-99f7f322b4b4) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:48 user nova-compute[74048]: INFO os_vif [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:94:ad,bridge_name='br-int',has_traffic_filtering=True,id=d3c8049b-bdc5-494f-aa5f-036fb3218564,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c8049b-bd')
Oct 25 16:56:48 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Deleting instance files /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244_del
Oct 25 16:56:48 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Deletion of /opt/stack/data/nova/instances/063fb985-6780-4196-90b6-dc92ab263244_del complete
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.compute.manager [req-608ceff6-57b5-424c-81e2-449853defd65 req-6a9965e8-f880-42ab-ac0f-c31ce513b71e service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-608ceff6-57b5-424c-81e2-449853defd65 req-6a9965e8-f880-42ab-ac0f-c31ce513b71e service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-608ceff6-57b5-424c-81e2-449853defd65 req-6a9965e8-f880-42ab-ac0f-c31ce513b71e service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-608ceff6-57b5-424c-81e2-449853defd65 req-6a9965e8-f880-42ab-ac0f-c31ce513b71e service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.compute.manager [req-608ceff6-57b5-424c-81e2-449853defd65 req-6a9965e8-f880-42ab-ac0f-c31ce513b71e service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.compute.manager [req-608ceff6-57b5-424c-81e2-449853defd65 req-6a9965e8-f880-42ab-ac0f-c31ce513b71e service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-unplugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:56:48 user nova-compute[74048]: INFO nova.compute.manager [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 16:56:48 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:56:48 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:56:49 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Took 0.82 seconds to deallocate network for instance.
Oct 25 16:56:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-b6dc226e-a72e-4708-afe5-cdd93cdd7b32 req-18c85733-f032-43be-b267-503b9b098987 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-deleted-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:49 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:56:49 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:56:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:49 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Deleted allocations for instance 063fb985-6780-4196-90b6-dc92ab263244
Oct 25 16:56:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a68cabfe-1d3b-4dee-be59-13215e9d33c6 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "063fb985-6780-4196-90b6-dc92ab263244" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.152s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-3d9ed141-63e8-4343-8526-01353bee5932 req-60161814-6b34-478f-bf8e-c24bd5a72bf3 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:56:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3d9ed141-63e8-4343-8526-01353bee5932 req-60161814-6b34-478f-bf8e-c24bd5a72bf3 service nova] Acquiring lock "063fb985-6780-4196-90b6-dc92ab263244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3d9ed141-63e8-4343-8526-01353bee5932 req-60161814-6b34-478f-bf8e-c24bd5a72bf3 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3d9ed141-63e8-4343-8526-01353bee5932 req-60161814-6b34-478f-bf8e-c24bd5a72bf3 service nova] Lock "063fb985-6780-4196-90b6-dc92ab263244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:50 user nova-compute[74048]: DEBUG nova.compute.manager [req-3d9ed141-63e8-4343-8526-01353bee5932 req-60161814-6b34-478f-bf8e-c24bd5a72bf3 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] No waiting events found dispatching network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:56:50 user nova-compute[74048]: WARNING nova.compute.manager [req-3d9ed141-63e8-4343-8526-01353bee5932 req-60161814-6b34-478f-bf8e-c24bd5a72bf3 service nova] [instance: 063fb985-6780-4196-90b6-dc92ab263244] Received unexpected event network-vif-plugged-d3c8049b-bdc5-494f-aa5f-036fb3218564 for instance with vm_state deleted and task_state None.
Oct 25 16:56:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:56 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:56 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:56:57 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:56:58 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:56:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:57:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=25.125320434570312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:57:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:57:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:57:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG nova.objects.instance [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:02 user nova-compute[74048]: INFO nova.compute.manager [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attaching volume 12de38ff-f001-450f-8032-9f272a27ae65 to /dev/vdb
Oct 25 16:57:02 user nova-compute[74048]: DEBUG os_brick.utils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67da3a9-52d5-4630-a9fc-2f24e25a0dc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed8b52a-d845-4289-97e2-87b0007ef51b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec13cc-7b9c-4eb0-8ba9-6e6e2ccfb26c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5eb087-c6db-48cb-9f7e-2ca33677e8f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:57:02 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:57:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be401e-d8dc-4324-b93c-5804295619c9]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG os_brick.utils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:57:02 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating existing volume attachment record: bd047a74-3730-44c5-9b2d-bd48e802a11a {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:57:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [{"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:08 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:09 user nova-compute[74048]: INFO nova.compute.manager [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Detaching volume 9203dd84-e82e-4e7a-bb35-25bb0c719396
Oct 25 16:57:10 user nova-compute[74048]: INFO nova.virt.block_device [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Attempting to driver detach volume 9203dd84-e82e-4e7a-bb35-25bb0c719396 from mountpoint /dev/vdb
Oct 25 16:57:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Attempting to detach device vdb from instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:57:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:57:10 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:57:10 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 16:57:10 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:57:10 user nova-compute[74048]:   <serial>9203dd84-e82e-4e7a-bb35-25bb0c719396</serial>
Oct 25 16:57:10 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:57:10 user nova-compute[74048]: </disk>
Oct 25 16:57:10 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:57:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully detached device vdb from instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 from the persistent domain config.
Oct 25 16:57:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:57:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:57:10 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:57:10 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 16:57:10 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:57:10 user nova-compute[74048]:   <serial>9203dd84-e82e-4e7a-bb35-25bb0c719396</serial>
Oct 25 16:57:10 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:57:10 user nova-compute[74048]: </disk>
Oct 25 16:57:10 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:57:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:57:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxJtuOfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:57:20 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:57:20 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:57:20 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[761713db-81a1-447a-b1d9-8de267f7800d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:57:20 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64158da-227b-40f8-a1c5-a1a8edd067a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65] added
Oct 25 16:57:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e47a69-db1e-412c-958d-aab5cc0d31ea]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3bfce0-7705-4bee-823b-f3953a73100e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxJtuOfD {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxJtuOfD" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f99f47-c5d0-4d40-878f-18b2111e30f7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxJtuOfD'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[67446e3b-8069-4c8a-8526-f47cf3e699cf]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cce63a-d510-4ad8-900c-4248def7a579]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b10ad5-a987-4980-bcba-da64446aa932]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260]
Oct 25 16:57:20 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260] successful.
Oct 25 16:57:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa74af-0973-4a9e-96f1-a4b67115dcc4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ea845-0c51-494a-a5fd-6b279b512fb9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:20 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc6645d-d412-407a-ba5f-90967ad464ba]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:57:20 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxJtuOfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:57:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:57:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23061313866336361', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:57:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061313866336361', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:57:21 user nova-compute[74048]: DEBUG nova.objects.instance [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:57:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:57:21 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:57:21 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:57:21 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:57:21 user nova-compute[74048]:   <serial>12de38ff-f001-450f-8032-9f272a27ae65</serial>
Oct 25 16:57:21 user nova-compute[74048]: </disk>
Oct 25 16:57:21 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:57:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:57:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:57:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No VIF found with MAC fa:16:3e:a7:b2:ce, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:57:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-54b3cf1e-a022-47c4-8d40-0039ae195009 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.889s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:57:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:57:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:57:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:24 user nova-compute[74048]: INFO nova.compute.manager [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Detaching volume 12de38ff-f001-450f-8032-9f272a27ae65
Oct 25 16:57:24 user nova-compute[74048]: INFO nova.virt.block_device [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attempting to driver detach volume 12de38ff-f001-450f-8032-9f272a27ae65 from mountpoint /dev/vdb
Oct 25 16:57:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Attempting to detach device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:57:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:57:24 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:57:24 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:57:24 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:57:24 user nova-compute[74048]:   <serial>12de38ff-f001-450f-8032-9f272a27ae65</serial>
Oct 25 16:57:24 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:57:24 user nova-compute[74048]: </disk>
Oct 25 16:57:24 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:57:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config.
Oct 25 16:57:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:57:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:57:24 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:57:24 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:57:24 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:57:24 user nova-compute[74048]:   <serial>12de38ff-f001-450f-8032-9f272a27ae65</serial>
Oct 25 16:57:24 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:57:24 user nova-compute[74048]: </disk>
Oct 25 16:57:24 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:57:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:57:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:30 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 is timed out.
Oct 25 16:57:30 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully detached device vdb from instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1 from the live domain config.
Oct 25 16:57:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXHzYvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:57:30 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c74269e-863a-48a3-878e-3d30e5f5cdd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:57:30 user nova-compute[74048]: No targets found.
Oct 25 16:57:30 user nova-compute[74048]: iSNS:
Oct 25 16:57:30 user nova-compute[74048]: No targets found.
Oct 25 16:57:30 user nova-compute[74048]: STATIC:
Oct 25 16:57:30 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396
Oct 25 16:57:30 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:30 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:30 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65
Oct 25 16:57:30 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:30 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:30 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:57:30 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:30 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:30 user nova-compute[74048]: FIRMWARE:
Oct 25 16:57:30 user nova-compute[74048]: No targets found.
Oct 25 16:57:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:57:30 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:57:30 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e3149-101e-4e30-8297-925bbca341a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daa8e59-8d02-46b1-8b4b-df9ace305be1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:30 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:57:30 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:30 user nova-compute[74048]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 (non-flash)
Oct 25 16:57:30 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18582d2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396'): ({'sdd'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Removing single pathed devices sdd {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86746a-956d-40ff-8965-580cfac907b0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e3b4d-b1e3-4d6d-99ea-cbcad156d7b6]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Flushing IO for device /dev/sdd {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e6e43-da3d-4596-881d-8fe03afd3021]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[69498093-2a5f-4fa4-9426-4271698babdf]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9484449d-065d-4b15-90f1-c5269d353306]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c74e48-f343-4021-ad70-9b58aab97e24]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260]
Oct 25 16:57:30 user nova-compute[74048]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396, portal: 172.16.0.220,3260] successful.
Oct 25 16:57:30 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[700eb595-3cd4-4ef8-8a49-e7e00521ec75]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== disconnect_volume: return (287ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:57:30 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG nova.objects.instance [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'flavor' on Instance uuid 37f397bc-dbe3-4285-a4db-cb3205fe88c1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-dce01aed-0212-4242-acaa-2eef8538de65 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.699s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:31 user nova-compute[74048]: INFO nova.compute.manager [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Terminating instance
Oct 25 16:57:31 user nova-compute[74048]: DEBUG nova.compute.manager [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-0c31d094-dea1-47f8-bd01-f0265366130a req-3706372c-8592-4669-bb71-aaa930d49ad7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-vif-unplugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0c31d094-dea1-47f8-bd01-f0265366130a req-3706372c-8592-4669-bb71-aaa930d49ad7 service nova] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0c31d094-dea1-47f8-bd01-f0265366130a req-3706372c-8592-4669-bb71-aaa930d49ad7 service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-0c31d094-dea1-47f8-bd01-f0265366130a req-3706372c-8592-4669-bb71-aaa930d49ad7 service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-0c31d094-dea1-47f8-bd01-f0265366130a req-3706372c-8592-4669-bb71-aaa930d49ad7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] No waiting events found dispatching network-vif-unplugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.compute.manager [req-0c31d094-dea1-47f8-bd01-f0265366130a req-3706372c-8592-4669-bb71-aaa930d49ad7 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-vif-unplugged-c84911a8-a9b8-4332-bac3-a74108ba7273 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Instance destroyed successfully.
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.objects.instance [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'resources' on Instance uuid 37f397bc-dbe3-4285-a4db-cb3205fe88c1 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:53:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1395469249',display_name='tempest-VolumesSnapshotTestJSON-instance-1395469249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1395469249',id=46,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsvbhrr47tKmiTM44P3uKZPgOvTZMoxSsFYZKmNlw0JIkeujNvKGqh1WI8Paa6RxFWTt7MWXf1rDrNH8tTGjU2ace37uPOjLErOyOsC8ik0bXPPYb1peWGY5VwA1K/FyA==',key_name='tempest-keypair-11629835',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a28c6406a21048bd88b6defdb0547fba',ramdisk_id='',reservation_id='r-zh60xake',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1876187338',owner_user_name='tempest-VolumesSnapshotTestJSON-1876187338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:53:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78ebbfe155248d28d49a46798eb5870',uuid=37f397bc-dbe3-4285-a4db-cb3205fe88c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converting VIF {"id": "c84911a8-a9b8-4332-bac3-a74108ba7273", "address": "fa:16:3e:12:e0:ad", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc84911a8-a9", "ovs_interfaceid": "c84911a8-a9b8-4332-bac3-a74108ba7273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_vif [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc84911a8-a9, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0eb770d-8989-49eb-adfb-12227bb82f92) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:32 user nova-compute[74048]: INFO os_vif [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:e0:ad,bridge_name='br-int',has_traffic_filtering=True,id=c84911a8-a9b8-4332-bac3-a74108ba7273,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc84911a8-a9')
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfXHzYvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:57:32 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c612c-e14a-416d-a036-87af3392efa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:57:32 user nova-compute[74048]: No targets found.
Oct 25 16:57:32 user nova-compute[74048]: iSNS:
Oct 25 16:57:32 user nova-compute[74048]: No targets found.
Oct 25 16:57:32 user nova-compute[74048]: STATIC:
Oct 25 16:57:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65
Oct 25 16:57:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:32 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:57:32 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:32 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:32 user nova-compute[74048]: FIRMWARE:
Oct 25 16:57:32 user nova-compute[74048]: No targets found.
Oct 25 16:57:32 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:57:32 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:57:32 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9203dd84-e82e-4e7a-bb35-25bb0c719396', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c09845-457a-4bf5-91c5-9224f5b40713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e8108-eeee-4680-8eaf-f4ff40772e62]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:32 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:32 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:32 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:32 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185024cf70>, {}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Disconnecting from: [] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== disconnect_volume: return (73ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:57:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Deleting instance files /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1_del
Oct 25 16:57:32 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Deletion of /opt/stack/data/nova/instances/37f397bc-dbe3-4285-a4db-cb3205fe88c1_del complete
Oct 25 16:57:32 user nova-compute[74048]: INFO nova.compute.manager [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 25 16:57:32 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:57:32 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:57:33 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:57:33 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Took 1.06 seconds to deallocate network for instance.
Oct 25 16:57:33 user nova-compute[74048]: WARNING nova.volume.cinder [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Attachment ce14a6a7-2e74-41ec-8b53-298c1d113ef9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ce14a6a7-2e74-41ec-8b53-298c1d113ef9. (HTTP 404) (Request-ID: req-667d5ada-e555-4ea8-8994-6aa376c72728)
Oct 25 16:57:33 user nova-compute[74048]: INFO nova.compute.manager [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Took 0.02 seconds to detach 1 volumes for instance.
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-638292e9-7775-4be7-8249-88a0fd1c3fa2 req-0ec055a3-a802-4f4b-8d22-611c0fa0f831 service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-vif-deleted-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-2c2ba982-9fb9-4621-a2df-aa2c854d5fdb req-669410f5-e9aa-4986-b081-f830b3ad742b service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received event network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c2ba982-9fb9-4621-a2df-aa2c854d5fdb req-669410f5-e9aa-4986-b081-f830b3ad742b service nova] Acquiring lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c2ba982-9fb9-4621-a2df-aa2c854d5fdb req-669410f5-e9aa-4986-b081-f830b3ad742b service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-2c2ba982-9fb9-4621-a2df-aa2c854d5fdb req-669410f5-e9aa-4986-b081-f830b3ad742b service nova] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG nova.compute.manager [req-2c2ba982-9fb9-4621-a2df-aa2c854d5fdb req-669410f5-e9aa-4986-b081-f830b3ad742b service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] No waiting events found dispatching network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:57:34 user nova-compute[74048]: WARNING nova.compute.manager [req-2c2ba982-9fb9-4621-a2df-aa2c854d5fdb req-669410f5-e9aa-4986-b081-f830b3ad742b service nova] [instance: 37f397bc-dbe3-4285-a4db-cb3205fe88c1] Received unexpected event network-vif-plugged-c84911a8-a9b8-4332-bac3-a74108ba7273 for instance with vm_state deleted and task_state None.
Oct 25 16:57:34 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:34 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Deleted allocations for instance 37f397bc-dbe3-4285-a4db-cb3205fe88c1
Oct 25 16:57:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-5efb8db3-8cbf-43cd-b027-7a31bd639671 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "37f397bc-dbe3-4285-a4db-cb3205fe88c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.550s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:57:41 user nova-compute[74048]: INFO nova.compute.claims [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Claim successful on node user
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.network.neutron [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:57:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.policy [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5010a1f24ffe411f849b0917ee40d17b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9cc47d22fc44f9babc2ec69f539e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:57:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Creating image(s)
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "/opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "/opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "/opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:41 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk 1073741824" returned: 0 in 0.049s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Successfully created port: 20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Cannot resize image /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Ensure instance console log exists: /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:42 user nova-compute[74048]: INFO nova.compute.manager [None req-04aa1521-2b61-481c-8b8e-0815bae81226 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Get console output
Oct 25 16:57:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:42 user nova-compute[74048]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Successfully updated port: 20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquired lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-changed-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.compute.manager [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Refreshing instance network info cache due to event network-changed-20d728d2-de7d-4f17-881c-52409dfbcf5f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] Acquiring lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:57:42 user nova-compute[74048]: DEBUG nova.network.neutron [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating instance_info_cache with network_info: [{"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Releasing lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Instance network_info: |[{"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] Acquired lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Refreshing network info cache for port 20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Start _get_guest_xml network_info=[{"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:57:43 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:57:43 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1512898355',display_name='tempest-AttachVolumeTestJSON-server-1512898355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1512898355',id=47,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/dB14WzYhtIH0AWeJS8oCw6VwSt6TYBWELgJMwyzU0Z+HU+EhPFxEYFnnx9my0suH5mIOhyJ6NQXgr782x2MKgfq4/eWV4Uqd8pXQndTSxTb/lD+0v13rMYvg2/4iybQ==',key_name='tempest-keypair-58835135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-9114rsdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=47773aef-3c92-4984-ba8e-bd4ff0425ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.objects.instance [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'pci_devices' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:57:43 user nova-compute[74048]:   <uuid>47773aef-3c92-4984-ba8e-bd4ff0425ea7</uuid>
Oct 25 16:57:43 user nova-compute[74048]:   <name>instance-0000002f</name>
Oct 25 16:57:43 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:57:43 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:57:43 user nova-compute[74048]:   <metadata>
Oct 25 16:57:43 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:57:43 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:57:43 user nova-compute[74048]:       <nova:name>tempest-AttachVolumeTestJSON-server-1512898355</nova:name>
Oct 25 16:57:43 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:57:43</nova:creationTime>
Oct 25 16:57:43 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:57:43 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:57:43 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:57:43 user nova-compute[74048]:       <nova:owner>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:user uuid="5010a1f24ffe411f849b0917ee40d17b">tempest-AttachVolumeTestJSON-251204741-project-member</nova:user>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:project uuid="4a9cc47d22fc44f9babc2ec69f539e77">tempest-AttachVolumeTestJSON-251204741</nova:project>
Oct 25 16:57:43 user nova-compute[74048]:       </nova:owner>
Oct 25 16:57:43 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:57:43 user nova-compute[74048]:       <nova:ports>
Oct 25 16:57:43 user nova-compute[74048]:         <nova:port uuid="20d728d2-de7d-4f17-881c-52409dfbcf5f">
Oct 25 16:57:43 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 16:57:43 user nova-compute[74048]:         </nova:port>
Oct 25 16:57:43 user nova-compute[74048]:       </nova:ports>
Oct 25 16:57:43 user nova-compute[74048]:     </nova:instance>
Oct 25 16:57:43 user nova-compute[74048]:   </metadata>
Oct 25 16:57:43 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:57:43 user nova-compute[74048]:     <system>
Oct 25 16:57:43 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:57:43 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:57:43 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:57:43 user nova-compute[74048]:       <entry name="serial">47773aef-3c92-4984-ba8e-bd4ff0425ea7</entry>
Oct 25 16:57:43 user nova-compute[74048]:       <entry name="uuid">47773aef-3c92-4984-ba8e-bd4ff0425ea7</entry>
Oct 25 16:57:43 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:57:43 user nova-compute[74048]:     </system>
Oct 25 16:57:43 user nova-compute[74048]:   </sysinfo>
Oct 25 16:57:43 user nova-compute[74048]:   <os>
Oct 25 16:57:43 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:57:43 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:57:43 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:57:43 user nova-compute[74048]:   </os>
Oct 25 16:57:43 user nova-compute[74048]:   <features>
Oct 25 16:57:43 user nova-compute[74048]:     <acpi/>
Oct 25 16:57:43 user nova-compute[74048]:     <apic/>
Oct 25 16:57:43 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:57:43 user nova-compute[74048]:   </features>
Oct 25 16:57:43 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:57:43 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:57:43 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:57:43 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:57:43 user nova-compute[74048]:   </clock>
Oct 25 16:57:43 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:57:43 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:57:43 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:57:43 user nova-compute[74048]:   </cpu>
Oct 25 16:57:43 user nova-compute[74048]:   <devices>
Oct 25 16:57:43 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:57:43 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:57:43 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk"/>
Oct 25 16:57:43 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:57:43 user nova-compute[74048]:     </disk>
Oct 25 16:57:43 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:57:43 user nova-compute[74048]:       <mac address="fa:16:3e:5b:79:13"/>
Oct 25 16:57:43 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:57:43 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:57:43 user nova-compute[74048]:       <target dev="tap20d728d2-de"/>
Oct 25 16:57:43 user nova-compute[74048]:     </interface>
Oct 25 16:57:43 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:57:43 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/console.log" append="off"/>
Oct 25 16:57:43 user nova-compute[74048]:     </serial>
Oct 25 16:57:43 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:57:43 user nova-compute[74048]:     <video>
Oct 25 16:57:43 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:57:43 user nova-compute[74048]:     </video>
Oct 25 16:57:43 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:57:43 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:57:43 user nova-compute[74048]:     </rng>
Oct 25 16:57:43 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:57:43 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:57:43 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:57:43 user nova-compute[74048]:     </memballoon>
Oct 25 16:57:43 user nova-compute[74048]:   </devices>
Oct 25 16:57:43 user nova-compute[74048]: </domain>
Oct 25 16:57:43 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1512898355',display_name='tempest-AttachVolumeTestJSON-server-1512898355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1512898355',id=47,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/dB14WzYhtIH0AWeJS8oCw6VwSt6TYBWELgJMwyzU0Z+HU+EhPFxEYFnnx9my0suH5mIOhyJ6NQXgr782x2MKgfq4/eWV4Uqd8pXQndTSxTb/lD+0v13rMYvg2/4iybQ==',key_name='tempest-keypair-58835135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-9114rsdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=47773aef-3c92-4984-ba8e-bd4ff0425ea7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG os_vif [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6651d64a-8529-533c-9517-ea0776ba1291', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20d728d2-de, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20d728d2-de, col_values=(('qos', UUID('7f17864f-9ca3-42a8-a377-577ba0f33ed2')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20d728d2-de, col_values=(('external_ids', {'iface-id': '20d728d2-de7d-4f17-881c-52409dfbcf5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:79:13', 'vm-uuid': '47773aef-3c92-4984-ba8e-bd4ff0425ea7'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:43 user nova-compute[74048]: INFO os_vif [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de')
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No VIF found with MAC fa:16:3e:5b:79:13, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updated VIF entry in instance network info cache for port 20d728d2-de7d-4f17-881c-52409dfbcf5f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG nova.network.neutron [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating instance_info_cache with network_info: [{"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:57:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-ec0d3c39-d324-47e6-b2a4-c0aeee359ae7 req-57b9ad43-122c-49ff-8c51-689c23b96a44 service nova] Releasing lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:44 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab is timed out.
Oct 25 16:57:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config.
Oct 25 16:57:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxJtuOfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:57:44 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-71811948-6089-4f2f-93be-f32974e8e6fa req-4b1513ee-e7fa-4e5d-adbc-36a3c1ac825a service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-71811948-6089-4f2f-93be-f32974e8e6fa req-4b1513ee-e7fa-4e5d-adbc-36a3c1ac825a service nova] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-71811948-6089-4f2f-93be-f32974e8e6fa req-4b1513ee-e7fa-4e5d-adbc-36a3c1ac825a service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-71811948-6089-4f2f-93be-f32974e8e6fa req-4b1513ee-e7fa-4e5d-adbc-36a3c1ac825a service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-71811948-6089-4f2f-93be-f32974e8e6fa req-4b1513ee-e7fa-4e5d-adbc-36a3c1ac825a service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] No waiting events found dispatching network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:57:44 user nova-compute[74048]: WARNING nova.compute.manager [req-71811948-6089-4f2f-93be-f32974e8e6fa req-4b1513ee-e7fa-4e5d-adbc-36a3c1ac825a service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received unexpected event network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f for instance with vm_state building and task_state spawning.
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b574314a-f66f-4c53-9466-9403c581addd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:57:44 user nova-compute[74048]: No targets found.
Oct 25 16:57:44 user nova-compute[74048]: iSNS:
Oct 25 16:57:44 user nova-compute[74048]: No targets found.
Oct 25 16:57:44 user nova-compute[74048]: STATIC:
Oct 25 16:57:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65
Oct 25 16:57:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:57:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:57:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:57:44 user nova-compute[74048]: FIRMWARE:
Oct 25 16:57:44 user nova-compute[74048]: No targets found.
Oct 25 16:57:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:57:44 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:57:44 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[598174ca-a40f-44fe-9ada-88781dc4db0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74c5f36-7090-44a8-b72e-2e8c3644ae5c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:44 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:57:44 user nova-compute[74048]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 (non-flash)
Oct 25 16:57:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184053fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[815601d1-88f1-4a9d-9ee8-4352a5efee03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba513420-93ac-468d-abeb-597af7bceb66]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:57:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db4b997-fc1c-4bfe-a962-d94a06a64001]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9505bc79-5f30-4e47-b73b-dd9cc3c3ceba]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a86f21-3879-4cdc-9680-efc5d7e556b8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0be55f-dbd2-4c60-8d51-736a90cd3da8]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260]
Oct 25 16:57:45 user nova-compute[74048]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65, portal: 172.16.0.220,3260] successful.
Oct 25 16:57:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de38ff-f001-450f-8032-9f272a27ae65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeec169-b75b-4393-b15f-a28af811facc]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== disconnect_volume: return (355ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG nova.objects.instance [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-95e1aa20-f63c-469c-a30b-4dcf9cfb24b5 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-aa0e3d7f-a12b-430a-84ae-c7661dd6f35e req-d5a11e7e-f1ac-482b-bfb7-1a2337ca4b4b service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aa0e3d7f-a12b-430a-84ae-c7661dd6f35e req-d5a11e7e-f1ac-482b-bfb7-1a2337ca4b4b service nova] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aa0e3d7f-a12b-430a-84ae-c7661dd6f35e req-d5a11e7e-f1ac-482b-bfb7-1a2337ca4b4b service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-aa0e3d7f-a12b-430a-84ae-c7661dd6f35e req-d5a11e7e-f1ac-482b-bfb7-1a2337ca4b4b service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-aa0e3d7f-a12b-430a-84ae-c7661dd6f35e req-d5a11e7e-f1ac-482b-bfb7-1a2337ca4b4b service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] No waiting events found dispatching network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:57:46 user nova-compute[74048]: WARNING nova.compute.manager [req-aa0e3d7f-a12b-430a-84ae-c7661dd6f35e req-d5a11e7e-f1ac-482b-bfb7-1a2337ca4b4b service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received unexpected event network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f for instance with vm_state building and task_state spawning.
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:57:47 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Instance spawned successfully.
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:57:47 user nova-compute[74048]: INFO nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 25 16:57:47 user nova-compute[74048]: DEBUG nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:57:47 user nova-compute[74048]: INFO nova.compute.manager [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Took 6.14 seconds to build instance.
Oct 25 16:57:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50991f0f-eafd-4d9e-9728-592da2c52301 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.244s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:57:57 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:57:58 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:57:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:58:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=25.141231536865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:58:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating instance_info_cache with network_info: [{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 16:58:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG nova.objects.instance [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:20 user nova-compute[74048]: INFO nova.compute.manager [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attaching volume d7ef7dce-b96c-4350-920e-a4df278b384c to /dev/vdb
Oct 25 16:58:20 user nova-compute[74048]: DEBUG os_brick.utils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8875a03f-4fc4-43f7-9545-204523f2428f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c5e91b-5113-418b-873e-a1dbe3625672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b604af-9cc5-451f-bc76-e0de7933e53d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c3817e-bb04-4cf2-a06b-a72a16b29781]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:58:21 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:58:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73a543d-62b9-4081-b922-0cc70b3166bb]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG os_brick.utils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating existing volume attachment record: ccd07f36-f23c-411c-8f69-e615c18166db {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:58:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:58:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:58:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:58:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:58:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:58:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaBhITqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:58:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:58:37 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:58:37 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388a081-40f4-4392-bd7b-2170af614749]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:58:37 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f363fb5-33ee-4085-873f-2e88d734bece]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c] added
Oct 25 16:58:37 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62cdb6f-665c-470f-a249-2a7119e118a3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:37 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7daa5-50a6-4eb2-afa8-c7ba3499239a]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaBhITqx {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaBhITqx" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d752b84e-0621-44fb-a84f-5a19d1cd6242]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WaBhITqx'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b7a719-d5df-45fb-8e13-cf8d34f374b3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b84ce5-fdbe-4c5d-ab4b-31a683f8a76c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:58:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:58:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[137ac84c-f314-48a0-8d6b-1636d10a706d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260]
Oct 25 16:58:38 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260] successful.
Oct 25 16:58:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1177d39e-5ba0-4c60-a2a1-068da03f8818]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c8fc04-e83e-4332-8609-d9bd35d0b7ed]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:58:38 user nova-compute[74048]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)
Oct 25 16:58:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:58:38 user nova-compute[74048]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)
Oct 25 16:58:38 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f137fa12-7566-42ab-b497-c5258eb94002]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:58:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaBhITqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26666303132646466', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666303132646466', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG nova.objects.instance [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:58:39 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:58:39 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:58:39 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:58:39 user nova-compute[74048]:   <serial>d7ef7dce-b96c-4350-920e-a4df278b384c</serial>
Oct 25 16:58:39 user nova-compute[74048]: </disk>
Oct 25 16:58:39 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No VIF found with MAC fa:16:3e:a7:b2:ce, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:58:39 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-849e328c-59ce-492b-bf52-f7b10e5d7ec8 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.913s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:41 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:41 user nova-compute[74048]: INFO nova.compute.manager [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Detaching volume d7ef7dce-b96c-4350-920e-a4df278b384c
Oct 25 16:58:41 user nova-compute[74048]: INFO nova.virt.block_device [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attempting to driver detach volume d7ef7dce-b96c-4350-920e-a4df278b384c from mountpoint /dev/vdb
Oct 25 16:58:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Attempting to detach device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 16:58:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:58:41 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:58:41 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:58:41 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:58:41 user nova-compute[74048]:   <serial>d7ef7dce-b96c-4350-920e-a4df278b384c</serial>
Oct 25 16:58:41 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:58:41 user nova-compute[74048]: </disk>
Oct 25 16:58:41 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:58:41 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config.
Oct 25 16:58:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 16:58:41 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 16:58:41 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:58:41 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:58:41 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:58:41 user nova-compute[74048]:   <serial>d7ef7dce-b96c-4350-920e-a4df278b384c</serial>
Oct 25 16:58:41 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 16:58:41 user nova-compute[74048]: </disk>
Oct 25 16:58:41 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:42 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 16:58:42 user nova-compute[74048]: INFO nova.compute.claims [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Claim successful on node user
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.network.neutron [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 16:58:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.policy [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e78ebbfe155248d28d49a46798eb5870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28c6406a21048bd88b6defdb0547fba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 16:58:43 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Creating image(s)
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "/opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "/opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:43 user nova-compute[74048]: INFO nova.compute.manager [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Terminating instance
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.193s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-74c1557e-d2ed-486a-bbf5-0986d00eeb5c req-a38d34b3-c913-4fd7-b254-067f0ac5759a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-unplugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-74c1557e-d2ed-486a-bbf5-0986d00eeb5c req-a38d34b3-c913-4fd7-b254-067f0ac5759a service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-74c1557e-d2ed-486a-bbf5-0986d00eeb5c req-a38d34b3-c913-4fd7-b254-067f0ac5759a service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-74c1557e-d2ed-486a-bbf5-0986d00eeb5c req-a38d34b3-c913-4fd7-b254-067f0ac5759a service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-74c1557e-d2ed-486a-bbf5-0986d00eeb5c req-a38d34b3-c913-4fd7-b254-067f0ac5759a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-unplugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.compute.manager [req-74c1557e-d2ed-486a-bbf5-0986d00eeb5c req-a38d34b3-c913-4fd7-b254-067f0ac5759a service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-unplugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk 1073741824" returned: 0 in 0.065s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 16:58:43 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.network.neutron [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Successfully created port: 0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Cannot resize image /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Ensure instance console log exists: /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Instance destroyed successfully.
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.objects.instance [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'resources' on Instance uuid 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:52:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-302978694',display_name='tempest-ServerActionsTestOtherA-server-302978694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-302978694',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-zkjnpk0l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "63d164cb-be72-47b9-b2f2-caf7d3118679", "address": "fa:16:3e:48:0b:54", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d164cb-be", "ovs_interfaceid": "63d164cb-be72-47b9-b2f2-caf7d3118679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_vif [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63d164cb-be, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fb35788-e928-456e-bae5-d1da8c49222b) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:44 user nova-compute[74048]: INFO os_vif [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=63d164cb-be72-47b9-b2f2-caf7d3118679,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d164cb-be')
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnKxqXDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:58:44 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd447f-8a3f-4d23-885e-44907cadfbc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:58:44 user nova-compute[74048]: No targets found.
Oct 25 16:58:44 user nova-compute[74048]: iSNS:
Oct 25 16:58:44 user nova-compute[74048]: No targets found.
Oct 25 16:58:44 user nova-compute[74048]: STATIC:
Oct 25 16:58:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c
Oct 25 16:58:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:58:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:58:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47
Oct 25 16:58:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:58:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:58:44 user nova-compute[74048]: FIRMWARE:
Oct 25 16:58:44 user nova-compute[74048]: No targets found.
Oct 25 16:58:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:58:44 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:58:44 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efbf0a0-7cf1-4fb8-9d18-2e2dff6224f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8edf428-557d-4c1d-817a-bdd37be3aabf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:58:44 user nova-compute[74048]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)
Oct 25 16:58:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 (non-flash)
Oct 25 16:58:44 user nova-compute[74048]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)
Oct 25 16:58:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1840312200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82f73c-118f-4b31-99eb-dd165eee89e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2df7c4-6aff-4ab5-8974-10da5e9ec082]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec3146-65ef-4df2-a8e8-1ee634bebdd7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[719006ce-54a4-4c3b-b2dd-0aee3f582502]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9fbedd-e93c-497f-97ef-4d9f3169ba4d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[58212408-1e20-4692-82cb-70379420d7e7]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260]
Oct 25 16:58:44 user nova-compute[74048]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47, portal: 172.16.0.220,3260] successful.
Oct 25 16:58:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe548c-2a52-42ff-8885-dcc3c406d352]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] <== disconnect_volume: return (286ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:58:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Deleting instance files /opt/stack/data/nova/instances/8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e_del
Oct 25 16:58:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Deletion of /opt/stack/data/nova/instances/8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e_del complete
Oct 25 16:58:44 user nova-compute[74048]: INFO nova.compute.manager [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 25 16:58:44 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:58:44 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Successfully updated port: 0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquired lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.neutron [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updating instance_info_cache with network_info: [{"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Releasing lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Instance network_info: |[{"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Start _get_guest_xml network_info=[{"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 16:58:45 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:58:45 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:58:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1872462684',display_name='tempest-VolumesSnapshotTestJSON-instance-1872462684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1872462684',id=48,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ1hPagfVUrBGgk0FN2RJ+vV83tu176uX0lAKyAyqa0CTv20zfOD01cRCIWK4u5FtNIcrIh3zFFYfdYrADkv4NlUEfoihNPla0PAG8m4arMzBTJpHBiranpi53xHHxMfg==',key_name='tempest-keypair-1229417259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a28c6406a21048bd88b6defdb0547fba',ramdisk_id='',reservation_id='r-feb0jrvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1876187338',owner_user_name='tempest-VolumesSnapshotTestJSON-1876187338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78ebbfe155248d28d49a46798eb5870',uuid=fe272fb2-0e4f-4e1a-a54e-af881343f2fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converting VIF {"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.objects.instance [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'pci_devices' on Instance uuid fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] Acquiring lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] No waiting events found dispatching network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:58:45 user nova-compute[74048]: WARNING nova.compute.manager [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received unexpected event network-vif-plugged-63d164cb-be72-47b9-b2f2-caf7d3118679 for instance with vm_state active and task_state deleting.
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-changed-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Refreshing instance network info cache due to event network-changed-0f38eb26-1b9c-492c-8950-f36127a4884b. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] Acquiring lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] Acquired lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Refreshing network info cache for port 0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] End _get_guest_xml xml=<domain type="kvm">
Oct 25 16:58:45 user nova-compute[74048]:   <uuid>fe272fb2-0e4f-4e1a-a54e-af881343f2fa</uuid>
Oct 25 16:58:45 user nova-compute[74048]:   <name>instance-00000030</name>
Oct 25 16:58:45 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 16:58:45 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 16:58:45 user nova-compute[74048]:   <metadata>
Oct 25 16:58:45 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 16:58:45 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 16:58:45 user nova-compute[74048]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1872462684</nova:name>
Oct 25 16:58:45 user nova-compute[74048]:       <nova:creationTime>2023-10-25 16:58:45</nova:creationTime>
Oct 25 16:58:45 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 16:58:45 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 16:58:45 user nova-compute[74048]:       </nova:flavor>
Oct 25 16:58:45 user nova-compute[74048]:       <nova:owner>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:user uuid="e78ebbfe155248d28d49a46798eb5870">tempest-VolumesSnapshotTestJSON-1876187338-project-member</nova:user>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:project uuid="a28c6406a21048bd88b6defdb0547fba">tempest-VolumesSnapshotTestJSON-1876187338</nova:project>
Oct 25 16:58:45 user nova-compute[74048]:       </nova:owner>
Oct 25 16:58:45 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 16:58:45 user nova-compute[74048]:       <nova:ports>
Oct 25 16:58:45 user nova-compute[74048]:         <nova:port uuid="0f38eb26-1b9c-492c-8950-f36127a4884b">
Oct 25 16:58:45 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 16:58:45 user nova-compute[74048]:         </nova:port>
Oct 25 16:58:45 user nova-compute[74048]:       </nova:ports>
Oct 25 16:58:45 user nova-compute[74048]:     </nova:instance>
Oct 25 16:58:45 user nova-compute[74048]:   </metadata>
Oct 25 16:58:45 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 16:58:45 user nova-compute[74048]:     <system>
Oct 25 16:58:45 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 16:58:45 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 16:58:45 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 16:58:45 user nova-compute[74048]:       <entry name="serial">fe272fb2-0e4f-4e1a-a54e-af881343f2fa</entry>
Oct 25 16:58:45 user nova-compute[74048]:       <entry name="uuid">fe272fb2-0e4f-4e1a-a54e-af881343f2fa</entry>
Oct 25 16:58:45 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 16:58:45 user nova-compute[74048]:     </system>
Oct 25 16:58:45 user nova-compute[74048]:   </sysinfo>
Oct 25 16:58:45 user nova-compute[74048]:   <os>
Oct 25 16:58:45 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 16:58:45 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 16:58:45 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 16:58:45 user nova-compute[74048]:   </os>
Oct 25 16:58:45 user nova-compute[74048]:   <features>
Oct 25 16:58:45 user nova-compute[74048]:     <acpi/>
Oct 25 16:58:45 user nova-compute[74048]:     <apic/>
Oct 25 16:58:45 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 16:58:45 user nova-compute[74048]:   </features>
Oct 25 16:58:45 user nova-compute[74048]:   <clock offset="utc">
Oct 25 16:58:45 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 16:58:45 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 16:58:45 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 16:58:45 user nova-compute[74048]:   </clock>
Oct 25 16:58:45 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 16:58:45 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 16:58:45 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 16:58:45 user nova-compute[74048]:   </cpu>
Oct 25 16:58:45 user nova-compute[74048]:   <devices>
Oct 25 16:58:45 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 16:58:45 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 16:58:45 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk"/>
Oct 25 16:58:45 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 16:58:45 user nova-compute[74048]:     </disk>
Oct 25 16:58:45 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 16:58:45 user nova-compute[74048]:       <mac address="fa:16:3e:50:49:30"/>
Oct 25 16:58:45 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:58:45 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 16:58:45 user nova-compute[74048]:       <target dev="tap0f38eb26-1b"/>
Oct 25 16:58:45 user nova-compute[74048]:     </interface>
Oct 25 16:58:45 user nova-compute[74048]:     <serial type="pty">
Oct 25 16:58:45 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/console.log" append="off"/>
Oct 25 16:58:45 user nova-compute[74048]:     </serial>
Oct 25 16:58:45 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 16:58:45 user nova-compute[74048]:     <video>
Oct 25 16:58:45 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 16:58:45 user nova-compute[74048]:     </video>
Oct 25 16:58:45 user nova-compute[74048]:     <rng model="virtio">
Oct 25 16:58:45 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 16:58:45 user nova-compute[74048]:     </rng>
Oct 25 16:58:45 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 16:58:45 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 16:58:45 user nova-compute[74048]:       <stats period="10"/>
Oct 25 16:58:45 user nova-compute[74048]:     </memballoon>
Oct 25 16:58:45 user nova-compute[74048]:   </devices>
Oct 25 16:58:45 user nova-compute[74048]: </domain>
Oct 25 16:58:45 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:58:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1872462684',display_name='tempest-VolumesSnapshotTestJSON-instance-1872462684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1872462684',id=48,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ1hPagfVUrBGgk0FN2RJ+vV83tu176uX0lAKyAyqa0CTv20zfOD01cRCIWK4u5FtNIcrIh3zFFYfdYrADkv4NlUEfoihNPla0PAG8m4arMzBTJpHBiranpi53xHHxMfg==',key_name='tempest-keypair-1229417259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a28c6406a21048bd88b6defdb0547fba',ramdisk_id='',reservation_id='r-feb0jrvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1876187338',owner_user_name='tempest-VolumesSnapshotTestJSON-1876187338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T16:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78ebbfe155248d28d49a46798eb5870',uuid=fe272fb2-0e4f-4e1a-a54e-af881343f2fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converting VIF {"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG os_vif [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a2f0ad4-b548-50c9-b674-0f124c91450f', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f38eb26-1b, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f38eb26-1b, col_values=(('qos', UUID('5b596405-4521-492c-bc46-76e494446e50')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f38eb26-1b, col_values=(('external_ids', {'iface-id': '0f38eb26-1b9c-492c-8950-f36127a4884b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:49:30', 'vm-uuid': 'fe272fb2-0e4f-4e1a-a54e-af881343f2fa'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:58:45 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Took 1.30 seconds to deallocate network for instance.
Oct 25 16:58:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:45 user nova-compute[74048]: INFO os_vif [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b')
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:58:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No VIF found with MAC fa:16:3e:50:49:30, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:58:46 user nova-compute[74048]: DEBUG nova.network.neutron [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updated VIF entry in instance network info cache for port 0f38eb26-1b9c-492c-8950-f36127a4884b. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:58:46 user nova-compute[74048]: DEBUG nova.network.neutron [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updating instance_info_cache with network_info: [{"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:58:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3fbc8ab1-ee6b-4fa0-9f10-cb33991fb7fe req-b0215239-7deb-4539-8015-672dc742b25b service nova] Releasing lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:58:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:46 user nova-compute[74048]: INFO nova.compute.manager [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Took 0.88 seconds to detach 1 volumes for instance.
Oct 25 16:58:46 user nova-compute[74048]: DEBUG nova.compute.manager [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Deleting volume: 83f10dfe-a4df-4f49-8800-4ae1e5cc9c47 {{(pid=74048) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 16:58:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:47 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Deleted allocations for instance 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e
Oct 25 16:58:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-573148c7-a35c-490a-b88d-c49375666b4b tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.865s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-3cdca176-3ac0-4dfd-8ec6-5a3955c0beed req-d4297d80-648b-4cd6-b470-393322a57a38 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3cdca176-3ac0-4dfd-8ec6-5a3955c0beed req-d4297d80-648b-4cd6-b470-393322a57a38 service nova] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3cdca176-3ac0-4dfd-8ec6-5a3955c0beed req-d4297d80-648b-4cd6-b470-393322a57a38 service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3cdca176-3ac0-4dfd-8ec6-5a3955c0beed req-d4297d80-648b-4cd6-b470-393322a57a38 service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-3cdca176-3ac0-4dfd-8ec6-5a3955c0beed req-d4297d80-648b-4cd6-b470-393322a57a38 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] No waiting events found dispatching network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:58:47 user nova-compute[74048]: WARNING nova.compute.manager [req-3cdca176-3ac0-4dfd-8ec6-5a3955c0beed req-d4297d80-648b-4cd6-b470-393322a57a38 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received unexpected event network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b for instance with vm_state building and task_state spawning.
Oct 25 16:58:47 user nova-compute[74048]: DEBUG nova.compute.manager [req-fff7b929-6c16-478b-af1a-eb34e114eeae req-0707cd00-b8fd-4c63-9ac5-2b21055bf431 service nova] [instance: 8b87db96-cf1c-4860-ba68-c1b2d0a4ee2e] Received event network-vif-deleted-63d164cb-be72-47b9-b2f2-caf7d3118679 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 16:58:49 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Instance spawned successfully.
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-05142362-993a-41dd-8c26-87b02cc9f00e req-a81dcd7b-02c9-41c1-9076-1f293f50648e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-05142362-993a-41dd-8c26-87b02cc9f00e req-a81dcd7b-02c9-41c1-9076-1f293f50648e service nova] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-05142362-993a-41dd-8c26-87b02cc9f00e req-a81dcd7b-02c9-41c1-9076-1f293f50648e service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-05142362-993a-41dd-8c26-87b02cc9f00e req-a81dcd7b-02c9-41c1-9076-1f293f50648e service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.compute.manager [req-05142362-993a-41dd-8c26-87b02cc9f00e req-a81dcd7b-02c9-41c1-9076-1f293f50648e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] No waiting events found dispatching network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:58:49 user nova-compute[74048]: WARNING nova.compute.manager [req-05142362-993a-41dd-8c26-87b02cc9f00e req-a81dcd7b-02c9-41c1-9076-1f293f50648e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received unexpected event network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b for instance with vm_state building and task_state spawning.
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 16:58:49 user nova-compute[74048]: INFO nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Took 6.44 seconds to spawn the instance on the hypervisor.
Oct 25 16:58:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 16:58:49 user nova-compute[74048]: INFO nova.compute.manager [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Took 7.15 seconds to build instance.
Oct 25 16:58:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-403f689f-bb55-4946-9f59-f3e2eb88cc74 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.249s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:58:58 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:58:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:58:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:58:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:58:58 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:58:59 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:59:00 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 16:59:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8479MB free_disk=25.109947204589844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 16:59:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 16:59:02 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab is timed out.
Oct 25 16:59:02 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config.
Oct 25 16:59:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaBhITqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:59:02 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fcd326-ae60-44c0-80b2-7d1a98cd1ac3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 16:59:02 user nova-compute[74048]: No targets found.
Oct 25 16:59:02 user nova-compute[74048]: iSNS:
Oct 25 16:59:02 user nova-compute[74048]: No targets found.
Oct 25 16:59:02 user nova-compute[74048]: STATIC:
Oct 25 16:59:02 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c
Oct 25 16:59:02 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 16:59:02 user nova-compute[74048]:                 Iface Name: default
Oct 25 16:59:02 user nova-compute[74048]: FIRMWARE:
Oct 25 16:59:02 user nova-compute[74048]: No targets found.
Oct 25 16:59:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 16:59:02 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 16:59:02 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f99a76-1fb3-4c47-b4b7-ce6c9cc631a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea89271-17de-42c3-ad6f-95e287d83d73]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)
Oct 25 16:59:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c (non-flash)
Oct 25 16:59:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185b58b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513be6e-5a2c-42ef-974c-ccecc93f93b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd57d5-50ac-4631-98e2-25f2f9d17bf3]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6291cf17-4f41-4ae0-9641-4c40864335d7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a0cb35-f16e-426a-a813-1fc75c415439]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[193817cf-479e-4ff2-9083-08c2041e6fb6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491f387-2f47-41fb-9f68-a05c132f21c2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260]
Oct 25 16:59:02 user nova-compute[74048]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c, portal: 172.16.0.220,3260] successful.
Oct 25 16:59:02 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ef7dce-b96c-4350-920e-a4df278b384c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e7d951-8257-4ed9-b560-36fa079703a7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== disconnect_volume: return (287ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:59:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 16:59:03 user nova-compute[74048]: DEBUG nova.objects.instance [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:59:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-50b13d90-2f98-40ef-b325-05f381b9b412 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:59:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 16:59:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 16:59:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 16:59:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:59:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-changed-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:59:31 user nova-compute[74048]: DEBUG nova.compute.manager [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Refreshing instance network info cache due to event network-changed-20d728d2-de7d-4f17-881c-52409dfbcf5f. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 16:59:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] Acquiring lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 16:59:31 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] Acquired lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 16:59:31 user nova-compute[74048]: DEBUG nova.network.neutron [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Refreshing network info cache for port 20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 16:59:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updated VIF entry in instance network info cache for port 20d728d2-de7d-4f17-881c-52409dfbcf5f. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 16:59:32 user nova-compute[74048]: DEBUG nova.network.neutron [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating instance_info_cache with network_info: [{"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:59:32 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-24d12836-981f-40e1-a6e8-1e0a1b75f352 req-c9fbf78b-ddbc-43b5-a734-7154b410c8e4 service nova] Releasing lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 16:59:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG nova.objects.instance [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:37 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:37 user nova-compute[74048]: INFO nova.compute.manager [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attaching volume b1e2dadd-463b-445b-9605-a8bcd9da8648 to /dev/vdb
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.utils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eb2712-0818-44e4-93bc-8555ce8ad947]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[07689ace-4b4d-4d30-a8b3-bfa8f5a680d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a9223e-de89-4bb6-9145-bdfe5ee50575]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d6f115-ccf0-4dcb-b8b3-5bd8ea868cbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:59:38 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1013d4e-9d8b-4b22-b6ec-6b65ad01c32b]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.utils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating existing volume attachment record: d257a60e-bc73-48c6-9d7d-3e757ef67679 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:38 user nova-compute[74048]: INFO nova.compute.manager [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attaching volume db06ed13-9db7-4c8d-987b-84c6638fbaf1 to /dev/vdb
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.utils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1012077-d804-470f-b93a-91bd7f415855]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[14067777-cce1-4fab-a126-bf1b7cb3db1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d365d520-2170-43f6-9dd5-b2f3c00a892f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c3f3d-93a8-4bbd-b6ee-1be8d7db20da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 16:59:38 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 16:59:38 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5cd91c-934f-435e-aead-4787ac5b6847]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG os_brick.utils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:59:38 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating existing volume attachment record: fa128a3b-5121-4af6-a581-67fdd2803fc1 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 16:59:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:43 user nova-compute[74048]: INFO nova.compute.manager [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Terminating instance
Oct 25 16:59:43 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-36e52935-cac3-4d41-9a21-c24e4bddd9d4 req-576a435a-d235-4324-a5f9-0282974982fa service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-vif-unplugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-36e52935-cac3-4d41-9a21-c24e4bddd9d4 req-576a435a-d235-4324-a5f9-0282974982fa service nova] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-36e52935-cac3-4d41-9a21-c24e4bddd9d4 req-576a435a-d235-4324-a5f9-0282974982fa service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-36e52935-cac3-4d41-9a21-c24e4bddd9d4 req-576a435a-d235-4324-a5f9-0282974982fa service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-36e52935-cac3-4d41-9a21-c24e4bddd9d4 req-576a435a-d235-4324-a5f9-0282974982fa service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] No waiting events found dispatching network-vif-unplugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.compute.manager [req-36e52935-cac3-4d41-9a21-c24e4bddd9d4 req-576a435a-d235-4324-a5f9-0282974982fa service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-vif-unplugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Instance destroyed successfully.
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lazy-loading 'resources' on Instance uuid 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-140518444',display_name='tempest-ServerActionsTestOtherA-server-140518444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-140518444',id=4,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY72cx1iLBc9StV8oxoM03MdR4wAbu3B/wEnsStL2hXYadpAcf2oa5WwzcmlbMjxOan38ykM73HsRv9dDs3kgW1h0bx8pVgvkocwkBWnP3ocpgriwVex4Pfyv1SthxyjA==',key_name='tempest-keypair-1780027392',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:24:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ad2347aaae1424681b490608fde8b08',ramdisk_id='',reservation_id='r-cztxuniz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-318048713',owner_user_name='tempest-ServerActionsTestOtherA-318048713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:24:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c809d630a78d4ce4bef9a9462543d2ad',uuid=85b4351f-c0e6-4fb8-9607-e0d8eb017ee2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converting VIF {"id": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "address": "fa:16:3e:b9:36:b0", "network": {"id": "70751d49-6458-4cbd-be44-189d6cb071da", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85231717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ad2347aaae1424681b490608fde8b08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba57bbe-a7", "ovs_interfaceid": "cba57bbe-a7a5-4d0f-981d-66bcd9d81974", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG os_vif [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcba57bbe-a7, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ece51ada-1ce2-4bf4-9df5-59b1f7d194ea) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:44 user nova-compute[74048]: INFO os_vif [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:36:b0,bridge_name='br-int',has_traffic_filtering=True,id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974,network=Network(70751d49-6458-4cbd-be44-189d6cb071da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba57bbe-a7')
Oct 25 16:59:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Deleting instance files /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2_del
Oct 25 16:59:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Deletion of /opt/stack/data/nova/instances/85b4351f-c0e6-4fb8-9607-e0d8eb017ee2_del complete
Oct 25 16:59:44 user nova-compute[74048]: INFO nova.compute.manager [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 25 16:59:44 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 16:59:44 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:59:45 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Took 0.49 seconds to deallocate network for instance.
Oct 25 16:59:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-a4da082b-162c-4d0c-9e40-04f557586715 req-281f780a-2b0b-4a4d-9224-a0e6caa8219c service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-vif-deleted-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:59:45 user nova-compute[74048]: INFO nova.compute.manager [req-a4da082b-162c-4d0c-9e40-04f557586715 req-281f780a-2b0b-4a4d-9224-a0e6caa8219c service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Neutron deleted interface cba57bbe-a7a5-4d0f-981d-66bcd9d81974; detaching it from the instance and deleting it from the info cache
Oct 25 16:59:45 user nova-compute[74048]: DEBUG nova.network.neutron [req-a4da082b-162c-4d0c-9e40-04f557586715 req-281f780a-2b0b-4a4d-9224-a0e6caa8219c service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG nova.compute.manager [req-a4da082b-162c-4d0c-9e40-04f557586715 req-281f780a-2b0b-4a4d-9224-a0e6caa8219c service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Detach interface failed, port_id=cba57bbe-a7a5-4d0f-981d-66bcd9d81974, reason: Instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 16:59:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:45 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Deleted allocations for instance 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2
Oct 25 16:59:45 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d2429146-437f-4232-9ae8-d45a9c1db799 tempest-ServerActionsTestOtherA-318048713 tempest-ServerActionsTestOtherA-318048713-project-member] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.773s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-bc6d4f03-f213-418f-ad4f-cef63e607e1c req-6f809fe2-2540-4d22-a626-7d60cd3d4a6b service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received event network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 16:59:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bc6d4f03-f213-418f-ad4f-cef63e607e1c req-6f809fe2-2540-4d22-a626-7d60cd3d4a6b service nova] Acquiring lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 16:59:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bc6d4f03-f213-418f-ad4f-cef63e607e1c req-6f809fe2-2540-4d22-a626-7d60cd3d4a6b service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 16:59:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bc6d4f03-f213-418f-ad4f-cef63e607e1c req-6f809fe2-2540-4d22-a626-7d60cd3d4a6b service nova] Lock "85b4351f-c0e6-4fb8-9607-e0d8eb017ee2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:46 user nova-compute[74048]: DEBUG nova.compute.manager [req-bc6d4f03-f213-418f-ad4f-cef63e607e1c req-6f809fe2-2540-4d22-a626-7d60cd3d4a6b service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] No waiting events found dispatching network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 16:59:46 user nova-compute[74048]: WARNING nova.compute.manager [req-bc6d4f03-f213-418f-ad4f-cef63e607e1c req-6f809fe2-2540-4d22-a626-7d60cd3d4a6b service nova] [instance: 85b4351f-c0e6-4fb8-9607-e0d8eb017ee2] Received unexpected event network-vif-plugged-cba57bbe-a7a5-4d0f-981d-66bcd9d81974 for instance with vm_state deleted and task_state None.
Oct 25 16:59:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxFufocB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:59:55 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:59:55 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:59:55 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94b6cca-67ee-43fe-9996-a0127bff2e1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:59:55 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a22db5-c665-450b-986b-62efee4dce2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648] added
Oct 25 16:59:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3dddc-d17a-48ef-bf62-c60f4e853478]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d14ccf-11cf-4f49-9b10-9bb5fc90e67e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxFufocB {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WxFufocB" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e543cc-c485-4eda-bd99-4ea27fe128a4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WxFufocB'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4bea02-e1a0-4a86-bbc3-bf1d4065a5f2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[06476dcd-66ab-4a3b-98e4-1c9c05c81964]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:59:55 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 16:59:55 user nova-compute[74048]:  {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:59:55 user nova-compute[74048]: WARNING os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 16:59:55 user nova-compute[74048]: 
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d8819-765e-40e2-bf33-f5eab78177c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260]
Oct 25 16:59:55 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260] successful.
Oct 25 16:59:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[53998c2b-1600-4f97-829a-99f28ecbbb18]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef048eb-c438-4187-9b53-6742ed542e88]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 16:59:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 16:59:55 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efd8089-2c68-4eb2-ace5-3702e098c52a]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxFufocB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSqzEiAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 16:59:55 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:59:55 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23962363864643031', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363864643031', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.967s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:59:56 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 16:59:56 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG nova.objects.instance [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c4fe75-173a-49e1-a1f3-2b300fdf488e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 16:59:56 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:59:56 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:59:56 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 16:59:56 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:59:56 user nova-compute[74048]:   <serial>b1e2dadd-463b-445b-9605-a8bcd9da8648</serial>
Oct 25 16:59:56 user nova-compute[74048]: </disk>
Oct 25 16:59:56 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0975a08a-21ab-473c-80d9-2f6af7026b4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1] added
Oct 25 16:59:56 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4349bdc-186d-4bff-9006-1a30af8b65e8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac39b4-1037-47c5-9291-19d620c39175]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eSqzEiAF {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eSqzEiAF" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:56 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3acfaa1-4b8f-46e6-8c21-a67d4a8d5478]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eSqzEiAF'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f5465-70db-4be7-84df-8cdb478883a9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd2ca9-4f13-4f01-8e22-838c86565bf3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 16:59:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 16:59:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e7811-0702-4303-845e-378d740d0cad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260]
Oct 25 16:59:57 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260] successful.
Oct 25 16:59:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2cc59a-fc30-4fcd-8468-86d70675573f]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[37870908-0bfc-460d-b5f8-df53f32efc6e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 16:59:57 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 16:59:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 16:59:57 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 16:59:57 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9f043-b8b9-46db-9bee-e5de9de6c7cc]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSqzEiAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No VIF found with MAC fa:16:3e:5b:79:13, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:59:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-8dd24542-62ab-4088-885b-3a84dcce9b42 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.640s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== connect_volume: return (2249ms) {'type': 'block', 'scsi_wwn': '23966626565663739', 'path': '/dev/sdc'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966626565663739', 'path': '/dev/sdc'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 16:59:58 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 16:59:58 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 16:59:58 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 16:59:58 user nova-compute[74048]:   <serial>db06ed13-9db7-4c8d-987b-84c6638fbaf1</serial>
Oct 25 16:59:58 user nova-compute[74048]: </disk>
Oct 25 16:59:58 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] No VIF found with MAC fa:16:3e:a7:b2:ce, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 16:59:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-a044f757-3d04-49d1-a0f1-55462f3f587c tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.552s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 16:59:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 16:59:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 16:59:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 16:59:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:59:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 16:59:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:00 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:00 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:00 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:01 user nova-compute[74048]: INFO nova.compute.manager [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Detaching volume db06ed13-9db7-4c8d-987b-84c6638fbaf1
Oct 25 17:00:01 user nova-compute[74048]: INFO nova.virt.block_device [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Attempting to driver detach volume db06ed13-9db7-4c8d-987b-84c6638fbaf1 from mountpoint /dev/vdb
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Attempting to detach device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:00:01 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:01 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 17:00:01 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:00:01 user nova-compute[74048]:   <serial>db06ed13-9db7-4c8d-987b-84c6638fbaf1</serial>
Oct 25 17:00:01 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:00:01 user nova-compute[74048]: </disk>
Oct 25 17:00:01 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:00:01 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the persistent domain config.
Oct 25 17:00:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:00:01 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:01 user nova-compute[74048]:   <source dev="/dev/sdc"/>
Oct 25 17:00:01 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:00:01 user nova-compute[74048]:   <serial>db06ed13-9db7-4c8d-987b-84c6638fbaf1</serial>
Oct 25 17:00:01 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:00:01 user nova-compute[74048]: </disk>
Oct 25 17:00:01 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:00:01 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:02 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:00:02 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=25.100276947021484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:00:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:00:03 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:00:03 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:00:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:00:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:04 user nova-compute[74048]: INFO nova.compute.manager [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attaching volume 1ad97a88-dd99-441a-8f02-a68ddf63dc7b to /dev/vdc
Oct 25 17:00:04 user nova-compute[74048]: DEBUG os_brick.utils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5dcd3b-7d33-4055-94de-b014a36681a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798badf-b3fd-4680-a3c5-bce88c9d9b38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab1fec6-0b9c-4f1b-961b-ae19717a0ae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc93a2b-ffaa-4138-bef2-9efd01ff1318]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:00:04 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:00:04 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[35abe669-c152-4b79-8289-1cb82fb1100e]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG os_brick.utils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:00:04 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating existing volume attachment record: 3ebd9548-8afa-4741-83dd-7afb36080057 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:00:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:00:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating instance_info_cache with network_info: [{"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-84006653-191e-4f73-b505-741e2abb95ab" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:00:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:00:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:14 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:19 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkvyTZHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:00:21 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:00:21 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:00:21 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64a17e8-c8b8-41cf-9d0e-e06902e4b83d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:00:21 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531564f-b630-4213-8b6b-5498046584ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b] added
Oct 25 17:00:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f091acdf-1b52-4a1c-b3b8-c83d620669a3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d820deb1-6a56-4247-bee2-b7f27afaaa7e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkvyTZHI {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hkvyTZHI" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8ec572-38ac-489b-bba7-89ba2ab2f69d]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hkvyTZHI'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7217154-202b-44f2-b031-c92a0de4e8d6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e6299-bf00-4e17-bed7-5f6b8dd9159f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c7be3e-b072-4d0c-9c42-36dc9b5a65ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260]
Oct 25 17:00:21 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260] successful.
Oct 25 17:00:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dab7e7a-55bb-4097-96c3-abff9b84326e]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fee57b-5f74-4829-b849-9eb187cdc10d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 17:00:21 user nova-compute[74048]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:21 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5a231a-b21e-465e-87d9-31288af16db7]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:00:21 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkvyTZHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:00:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84006653-191e-4f73-b505-741e2abb95ab is timed out.
Oct 25 17:00:22 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully detached device vdb from instance 84006653-191e-4f73-b505-741e2abb95ab from the live domain config.
Oct 25 17:00:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSqzEiAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:00:22 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26432643838376537', 'path': '/dev/sdd'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432643838376537', 'path': '/dev/sdd'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.744s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[30025566-ff0b-4e6e-92db-4055f7b1142e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:00:22 user nova-compute[74048]: No targets found.
Oct 25 17:00:22 user nova-compute[74048]: iSNS:
Oct 25 17:00:22 user nova-compute[74048]: No targets found.
Oct 25 17:00:22 user nova-compute[74048]: STATIC:
Oct 25 17:00:22 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648
Oct 25 17:00:22 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:00:22 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:00:22 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1
Oct 25 17:00:22 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:00:22 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:00:22 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b
Oct 25 17:00:22 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:00:22 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:00:22 user nova-compute[74048]: FIRMWARE:
Oct 25 17:00:22 user nova-compute[74048]: No targets found.
Oct 25 17:00:22 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:00:22 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:00:22 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:00:22 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:22 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 17:00:22 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 17:00:22 user nova-compute[74048]:   <serial>1ad97a88-dd99-441a-8f02-a68ddf63dc7b</serial>
Oct 25 17:00:22 user nova-compute[74048]: </disk>
Oct 25 17:00:22 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f6dd54-fa2d-4069-bb08-c2d2fd877a7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dfbc77-a350-433d-aa54-5fbe12f387fd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:22 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 17:00:22 user nova-compute[74048]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:22 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:22 user nova-compute[74048]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 (non-flash)
Oct 25 17:00:22 user nova-compute[74048]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:22 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f184053cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1'): ({'sdc'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Removing single pathed devices sdc {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4d58e9-66e5-4cef-b74a-eec6dfad4beb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[295f7b68-dfa3-4b0e-97c9-89d5431c0eab]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Flushing IO for device /dev/sdc {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe69d3a-6425-4a64-8058-b957385a0e40]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:00:22 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[52109702-fafd-4487-89bc-a82713b9c8cc]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] SCSI volumes sdc have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3798d10-b94d-4c9c-80fb-fd37d0323ad1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c8959-0898-450a-9412-5e28e137fd9b]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260]
Oct 25 17:00:23 user nova-compute[74048]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1, portal: 172.16.0.220,3260] successful.
Oct 25 17:00:23 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db06ed13-9db7-4c8d-987b-84c6638fbaf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4776ddf4-e384-4c17-b301-bd4eafb830b7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] <== disconnect_volume: return (1035ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] No VIF found with MAC fa:16:3e:5b:79:13, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:00:23 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f00c2b94-d646-43e5-95fc-06172592d00f tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.780s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG nova.objects.instance [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'flavor' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-77f513e1-12c2-40bb-92c1-fbdd51afc777 tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.578s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:24 user nova-compute[74048]: INFO nova.compute.manager [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Detaching volume b1e2dadd-463b-445b-9605-a8bcd9da8648
Oct 25 17:00:24 user nova-compute[74048]: INFO nova.virt.block_device [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attempting to driver detach volume b1e2dadd-463b-445b-9605-a8bcd9da8648 from mountpoint /dev/vdb
Oct 25 17:00:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Attempting to detach device vdb from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:00:24 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:24 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 17:00:24 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:00:24 user nova-compute[74048]:   <serial>b1e2dadd-463b-445b-9605-a8bcd9da8648</serial>
Oct 25 17:00:24 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:00:24 user nova-compute[74048]: </disk>
Oct 25 17:00:24 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:00:24 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully detached device vdb from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the persistent domain config.
Oct 25 17:00:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:00:24 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:24 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 17:00:24 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:00:24 user nova-compute[74048]:   <serial>b1e2dadd-463b-445b-9605-a8bcd9da8648</serial>
Oct 25 17:00:24 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:00:24 user nova-compute[74048]: </disk>
Oct 25 17:00:24 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:00:24 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:00:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Verify base images {{(pid=74048) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Image id 67778d28-28b7-4dc4-a7ab-187332587d81 yields fingerprint db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 {{(pid=74048) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 17:00:27 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] image 67778d28-28b7-4dc4-a7ab-187332587d81 at (/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7): checking
Oct 25 17:00:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] image 67778d28-28b7-4dc4-a7ab-187332587d81 at (/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7): image is in use {{(pid=74048) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74048) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] 84006653-191e-4f73-b505-741e2abb95ab is a valid instance name {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] 84006653-191e-4f73-b505-741e2abb95ab has a disk file {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 17:00:27 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab is backed by db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] fe272fb2-0e4f-4e1a-a54e-af881343f2fa is a valid instance name {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] fe272fb2-0e4f-4e1a-a54e-af881343f2fa has a disk file {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa is backed by db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] 47773aef-3c92-4984-ba8e-bd4ff0425ea7 is a valid instance name {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] 47773aef-3c92-4984-ba8e-bd4ff0425ea7 has a disk file {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 is backed by db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 {{(pid=74048) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974
Oct 25 17:00:28 user nova-compute[74048]: WARNING nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Unknown base file: /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Active base files: /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Removable base files: /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86 /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5 /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278 /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974 /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e57772a6e90e723973b7e24b2289ad34795e8f86
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2f13c80841f22abf59843a0e3a5fc63505423bda
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0a24dd5bb7a5b58058bccc46795ddba2e729fdc
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/02a81e595e6ed8c85d5456b53912e1cb431845b5
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2e7d1205a776e28dabe98c13ec2dbd2dd67b4bfa
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf6657dc68de9a6d36fb66751cf978cb1dba34ab
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57d877183e90d2883e593020b9a62e1c41caf278
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/955c49baa5630cee9b154897de59132c69f52974
Oct 25 17:00:28 user nova-compute[74048]: INFO nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/20e5358194e0f631d72c54261e4429488b492a94
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Verification complete {{(pid=74048) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Verify swap images {{(pid=74048) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 25 17:00:28 user nova-compute[74048]: DEBUG nova.virt.libvirt.imagecache [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Verify ephemeral images {{(pid=74048) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 25 17:00:29 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-changed-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG nova.compute.manager [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Refreshing instance network info cache due to event network-changed-0f38eb26-1b9c-492c-8950-f36127a4884b. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] Acquiring lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] Acquired lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Refreshing network info cache for port 0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updated VIF entry in instance network info cache for port 0f38eb26-1b9c-492c-8950-f36127a4884b. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG nova.network.neutron [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updating instance_info_cache with network_info: [{"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:00:33 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e9f488e1-8191-48ca-afa2-aa8af048aba9 req-248f74f6-78a9-477d-8c88-f97f2d83803e service nova] Releasing lock "refresh_cache-fe272fb2-0e4f-4e1a-a54e-af881343f2fa" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:00:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:34 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'flavor' on Instance uuid fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:34 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Ignoring supplied device name: /dev/vdb
Oct 25 17:00:34 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:35 user nova-compute[74048]: INFO nova.compute.manager [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Attaching volume 09242edf-15da-4285-9f3c-12767da15a86 to /dev/vdb
Oct 25 17:00:35 user nova-compute[74048]: DEBUG os_brick.utils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[585d3123-0ff8-4408-a810-76a9523d8f23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19e69276e7d8\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[087a8d6c-e3f6-4cbf-9208-fabfa5eab1f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[218cff3c-66a2-435a-9e01-d15d17833890]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[82034268-85ec-49d8-b81e-2bd11fd3fe9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Running cmd (subprocess): nvme version {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] 'nvme version' failed. Not Retrying. {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] nvme not present on system {{(pid=74048) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:00:35 user nova-compute[74048]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:00:35 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce94c3a8-d7ba-4d1a-bf52-6044affe1186]: (4, '') {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74048) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.lightos [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] LIGHTOS: no hostnqn found. {{(pid=74048) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG os_brick.utils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19e69276e7d8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:00:35 user nova-compute[74048]: DEBUG nova.virt.block_device [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updating existing volume attachment record: ca2575ba-7a50-44a8-a218-76f91c575c20 {{(pid=74048) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:00:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:39 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:44 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 is timed out.
Oct 25 17:00:44 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully detached device vdb from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the live domain config.
Oct 25 17:00:44 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WxFufocB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:00:44 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b101b77-557d-48bc-942e-ace893570dea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:00:44 user nova-compute[74048]: No targets found.
Oct 25 17:00:44 user nova-compute[74048]: iSNS:
Oct 25 17:00:44 user nova-compute[74048]: No targets found.
Oct 25 17:00:44 user nova-compute[74048]: STATIC:
Oct 25 17:00:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648
Oct 25 17:00:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:00:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:00:44 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b
Oct 25 17:00:44 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:00:44 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:00:44 user nova-compute[74048]: FIRMWARE:
Oct 25 17:00:44 user nova-compute[74048]: No targets found.
Oct 25 17:00:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:00:44 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:00:44 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb91f47-f563-4ca1-8e8f-8b0bde866be9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf36fc-af40-4948-93da-79d439344ea4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:44 user nova-compute[74048]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 (non-flash)
Oct 25 17:00:44 user nova-compute[74048]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:44 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850296710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff43b805-8654-476c-8d9b-23c8072c6ac6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1618d-952f-4afc-9287-db878fdd5b52]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5191dc21-d596-491c-bc76-9c387925d440]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:00:44 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbec603-f9d6-4239-8ab1-0ba511ff47f0]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b5977b-cbb1-46dd-9bbe-3ea8cdcdbeb3]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1bfce5-fbc8-43c2-9611-a91439f43933]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260]
Oct 25 17:00:45 user nova-compute[74048]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648, portal: 172.16.0.220,3260] successful.
Oct 25 17:00:45 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e2dadd-463b-445b-9605-a8bcd9da8648 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[892978bf-16bc-489a-8b83-7bac392ef532]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== disconnect_volume: return (302ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:00:45 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:46 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f89912ea-64ec-4a61-8782-dcb907b046d0 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.715s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:00:47 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:00:47 user nova-compute[74048]: INFO nova.compute.manager [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Detaching volume 1ad97a88-dd99-441a-8f02-a68ddf63dc7b
Oct 25 17:00:47 user nova-compute[74048]: INFO nova.virt.block_device [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Attempting to driver detach volume 1ad97a88-dd99-441a-8f02-a68ddf63dc7b from mountpoint /dev/vdc
Oct 25 17:00:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Attempting to detach device vdc from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:00:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:00:47 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:47 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 17:00:47 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 17:00:47 user nova-compute[74048]:   <serial>1ad97a88-dd99-441a-8f02-a68ddf63dc7b</serial>
Oct 25 17:00:47 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 17:00:47 user nova-compute[74048]: </disk>
Oct 25 17:00:47 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:00:47 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully detached device vdc from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the persistent domain config.
Oct 25 17:00:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:00:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:00:47 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:47 user nova-compute[74048]:   <source dev="/dev/sdd"/>
Oct 25 17:00:47 user nova-compute[74048]:   <target dev="vdc" bus="virtio"/>
Oct 25 17:00:47 user nova-compute[74048]:   <serial>1ad97a88-dd99-441a-8f02-a68ddf63dc7b</serial>
Oct 25 17:00:47 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 17:00:47 user nova-compute[74048]: </disk>
Oct 25 17:00:47 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:00:47 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:00:49 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:00:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Calling os-brick to attach iSCSI Volume {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCBUrKJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:00:53 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:00:53 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:00:53 user nova-compute[74048]: INFO os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17478204-5901-40d6-a935-ac1410d68b8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:00:53 user nova-compute[74048]:  {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28654085-c7e8-4f4f-958e-d58c733eebf6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86] added\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86] added
Oct 25 17:00:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b353491-ce16-450d-a7da-2f41a65b30ef]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[741274b9-d12e-4c59-a2b4-d44402ea7721]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCBUrKJn {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCBUrKJn" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c8fa2e-2d8a-4d72-9975-1a86a8de12f8]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TCBUrKJn'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7fc234-4e6f-4c13-a362-26d94f4bee85]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d2a1e-c659-4fc6-b293-138b401c153f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --login {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ad19b-eaf0-4a0c-9a41-16f30dae45e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260]
Oct 25 17:00:53 user nova-compute[74048]: Login to [iface: default, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260] successful.
Oct 25 17:00:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ccb1fb-cbb2-42d5-b06d-cc233a05cfef]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[39199c46-c8bb-44eb-bdfd-85c628a13969]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:53 user nova-compute[74048]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)
Oct 25 17:00:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:00:53 user nova-compute[74048]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)
Oct 25 17:00:53 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Connected to 172.16.0.220:3260 {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74048) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74048) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b451220-4e2a-4a2a-801f-5ac6154fdb2b]: (4, ('- - 0', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74048) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:00:53 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCBUrKJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74048) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26131663231633434', 'path': '/dev/sdb'} {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131663231633434', 'path': '/dev/sdb'} {{(pid=74048) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG nova.objects.instance [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'flavor' on Instance uuid fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:00:54 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:00:54 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 17:00:54 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:00:54 user nova-compute[74048]:   <serial>09242edf-15da-4285-9f3c-12767da15a86</serial>
Oct 25 17:00:54 user nova-compute[74048]: </disk>
Oct 25 17:00:54 user nova-compute[74048]:  {{(pid=74048) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] No VIF found with MAC fa:16:3e:50:49:30, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:00:54 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-3f13d97d-bd08-4447-aa2e-d99405feda72 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.884s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:00:59 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74048) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:01:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=25.09769058227539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 17:01:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:07 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 is timed out.
Oct 25 17:01:07 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully detached device vdc from instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7 from the live domain config.
Oct 25 17:01:07 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hkvyTZHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:01:07 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef25d5b2-0284-4f7f-baa4-0f149b1c5ded]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:01:07 user nova-compute[74048]: No targets found.
Oct 25 17:01:07 user nova-compute[74048]: iSNS:
Oct 25 17:01:07 user nova-compute[74048]: No targets found.
Oct 25 17:01:07 user nova-compute[74048]: STATIC:
Oct 25 17:01:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86
Oct 25 17:01:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:01:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:01:07 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b
Oct 25 17:01:07 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:01:07 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:01:07 user nova-compute[74048]: FIRMWARE:
Oct 25 17:01:07 user nova-compute[74048]: No targets found.
Oct 25 17:01:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:01:07 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:01:07 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0fd0cb-cb2f-4996-8108-050baee655f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3036861c-baad-4fd2-b20b-f281bd106e51]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:01:07 user nova-compute[74048]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)
Oct 25 17:01:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b (non-flash)
Oct 25 17:01:07 user nova-compute[74048]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)
Oct 25 17:01:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18405c2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b'): ({'sdd'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Removing single pathed devices sdd {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc217a50-02d9-42ae-bd3a-34721dfe9bcc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c99b12-cb22-4cd4-be4d-bf9622579685]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Flushing IO for device /dev/sdd {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b81ed53-1829-430a-a9af-68b679260ae2]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60777c-a91a-4b84-a0df-5567bbc69566]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] SCSI volumes sdd have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab65d434-b673-4be8-a97a-52d230b0a2a9]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79cdc0-ff8e-46b3-b79f-3d2b51f345fd]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260]
Oct 25 17:01:07 user nova-compute[74048]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b, portal: 172.16.0.220,3260] successful.
Oct 25 17:01:07 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:01:07 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ad97a88-dd99-441a-8f02-a68ddf63dc7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5573c541-6e9a-4c82-a53d-22cfe86bf3f7]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] <== disconnect_volume: return (286ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG nova.objects.instance [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'flavor' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:01:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-9cbbacf6-714e-47d8-9435-6f36e71f7c78 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating instance_info_cache with network_info: [{"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-47773aef-3c92-4984-ba8e-bd4ff0425ea7" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:10 user nova-compute[74048]: INFO nova.compute.manager [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Terminating instance
Oct 25 17:01:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-d79d4ee4-38a9-4c28-9dfe-67e66d3e1bae req-e81a3851-6ccd-4858-8d82-8591d18271d6 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-vif-unplugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d79d4ee4-38a9-4c28-9dfe-67e66d3e1bae req-e81a3851-6ccd-4858-8d82-8591d18271d6 service nova] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d79d4ee4-38a9-4c28-9dfe-67e66d3e1bae req-e81a3851-6ccd-4858-8d82-8591d18271d6 service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-d79d4ee4-38a9-4c28-9dfe-67e66d3e1bae req-e81a3851-6ccd-4858-8d82-8591d18271d6 service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-d79d4ee4-38a9-4c28-9dfe-67e66d3e1bae req-e81a3851-6ccd-4858-8d82-8591d18271d6 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] No waiting events found dispatching network-vif-unplugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:01:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-d79d4ee4-38a9-4c28-9dfe-67e66d3e1bae req-e81a3851-6ccd-4858-8d82-8591d18271d6 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-vif-unplugged-20d728d2-de7d-4f17-881c-52409dfbcf5f for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:01:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Instance destroyed successfully.
Oct 25 17:01:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lazy-loading 'resources' on Instance uuid 47773aef-3c92-4984-ba8e-bd4ff0425ea7 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1512898355',display_name='tempest-AttachVolumeTestJSON-server-1512898355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1512898355',id=47,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/dB14WzYhtIH0AWeJS8oCw6VwSt6TYBWELgJMwyzU0Z+HU+EhPFxEYFnnx9my0suH5mIOhyJ6NQXgr782x2MKgfq4/eWV4Uqd8pXQndTSxTb/lD+0v13rMYvg2/4iybQ==',key_name='tempest-keypair-58835135',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a9cc47d22fc44f9babc2ec69f539e77',ramdisk_id='',reservation_id='r-9114rsdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-251204741',owner_user_name='tempest-AttachVolumeTestJSON-251204741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5010a1f24ffe411f849b0917ee40d17b',uuid=47773aef-3c92-4984-ba8e-bd4ff0425ea7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converting VIF {"id": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "address": "fa:16:3e:5b:79:13", "network": {"id": "67245a72-65b4-486e-a450-dee53a76a479", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-884665566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a9cc47d22fc44f9babc2ec69f539e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d728d2-de", "ovs_interfaceid": "20d728d2-de7d-4f17-881c-52409dfbcf5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG os_vif [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20d728d2-de, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f17864f-9ca3-42a8-a377-577ba0f33ed2) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:01:11 user nova-compute[74048]: INFO os_vif [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:79:13,bridge_name='br-int',has_traffic_filtering=True,id=20d728d2-de7d-4f17-881c-52409dfbcf5f,network=Network(67245a72-65b4-486e-a450-dee53a76a479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d728d2-de')
Oct 25 17:01:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Deleting instance files /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7_del
Oct 25 17:01:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Deletion of /opt/stack/data/nova/instances/47773aef-3c92-4984-ba8e-bd4ff0425ea7_del complete
Oct 25 17:01:11 user nova-compute[74048]: INFO nova.compute.manager [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 17:01:11 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:01:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:01:12 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Took 0.95 seconds to deallocate network for instance.
Oct 25 17:01:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-3d0924b1-a2b0-4e59-88f9-6a6add8ab264 req-4b86b3d0-39f5-4fd4-8c23-b4e535093cd6 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-vif-deleted-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:12 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Deleted allocations for instance 47773aef-3c92-4984-ba8e-bd4ff0425ea7
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-79227f05-d7ad-409d-a251-32d088de5359 tempest-AttachVolumeTestJSON-251204741 tempest-AttachVolumeTestJSON-251204741-project-member] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f610d71-2246-44b8-803a-82b7182e3ee6 req-24fe786f-f902-40cb-b085-7c2fe5f1af25 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received event network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f610d71-2246-44b8-803a-82b7182e3ee6 req-24fe786f-f902-40cb-b085-7c2fe5f1af25 service nova] Acquiring lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f610d71-2246-44b8-803a-82b7182e3ee6 req-24fe786f-f902-40cb-b085-7c2fe5f1af25 service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-4f610d71-2246-44b8-803a-82b7182e3ee6 req-24fe786f-f902-40cb-b085-7c2fe5f1af25 service nova] Lock "47773aef-3c92-4984-ba8e-bd4ff0425ea7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-4f610d71-2246-44b8-803a-82b7182e3ee6 req-24fe786f-f902-40cb-b085-7c2fe5f1af25 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] No waiting events found dispatching network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:01:12 user nova-compute[74048]: WARNING nova.compute.manager [req-4f610d71-2246-44b8-803a-82b7182e3ee6 req-24fe786f-f902-40cb-b085-7c2fe5f1af25 service nova] [instance: 47773aef-3c92-4984-ba8e-bd4ff0425ea7] Received unexpected event network-vif-plugged-20d728d2-de7d-4f17-881c-52409dfbcf5f for instance with vm_state deleted and task_state None.
Oct 25 17:01:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:01:23 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Triggering sync for uuid fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:29 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:01:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:01:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:01:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:01:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:44 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:48 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:48 user nova-compute[74048]: INFO nova.compute.manager [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Detaching volume 09242edf-15da-4285-9f3c-12767da15a86
Oct 25 17:01:48 user nova-compute[74048]: INFO nova.virt.block_device [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Attempting to driver detach volume 09242edf-15da-4285-9f3c-12767da15a86 from mountpoint /dev/vdb
Oct 25 17:01:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Attempting to detach device vdb from instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa from the persistent domain config. {{(pid=74048) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:01:48 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:01:48 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:01:48 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 17:01:48 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:01:48 user nova-compute[74048]:   <serial>09242edf-15da-4285-9f3c-12767da15a86</serial>
Oct 25 17:01:48 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:01:48 user nova-compute[74048]: </disk>
Oct 25 17:01:48 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:01:48 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully detached device vdb from instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa from the persistent domain config.
Oct 25 17:01:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa from the live domain config. {{(pid=74048) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.guest [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:01:49 user nova-compute[74048]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:01:49 user nova-compute[74048]:   <source dev="/dev/sdb"/>
Oct 25 17:01:49 user nova-compute[74048]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:01:49 user nova-compute[74048]:   <serial>09242edf-15da-4285-9f3c-12767da15a86</serial>
Oct 25 17:01:49 user nova-compute[74048]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:01:49 user nova-compute[74048]: </disk>
Oct 25 17:01:49 user nova-compute[74048]:  {{(pid=74048) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "429db749-f049-4e92-9582-9c05003f7f0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:49 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:01:49 user nova-compute[74048]: INFO nova.compute.claims [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Claim successful on node user
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:01:50 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.policy [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4107b1ecad164078a7ffa1060fe2b886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c297e8975e7a455d9d3f5c9b510d145a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:01:50 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Creating image(s)
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "/opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "/opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "/opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.170s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.210s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Successfully created port: bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk 1073741824" returned: 0 in 0.047s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:01:50 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Cannot resize image /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Ensure instance console log exists: /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Successfully updated port: bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquired lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-changed-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.compute.manager [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Refreshing instance network info cache due to event network-changed-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] Acquiring lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.neutron [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Updating instance_info_cache with network_info: [{"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Releasing lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Instance network_info: |[{"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] Acquired lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.neutron [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Refreshing network info cache for port bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Start _get_guest_xml network_info=[{"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:01:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:01:51 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-168228602',display_name='tempest-VolumesActionsTest-instance-168228602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-168228602',id=49,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c297e8975e7a455d9d3f5c9b510d145a',ramdisk_id='',reservation_id='r-u3x23zdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-475030454',owner_user_name='tempest-VolumesActionsTest-475030454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:01:50Z,user_data=None,user_id='4107b1ecad164078a7ffa1060fe2b886',uuid=429db749-f049-4e92-9582-9c05003f7f0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Converting VIF {"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.objects.instance [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lazy-loading 'pci_devices' on Instance uuid 429db749-f049-4e92-9582-9c05003f7f0b {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:01:51 user nova-compute[74048]:   <uuid>429db749-f049-4e92-9582-9c05003f7f0b</uuid>
Oct 25 17:01:51 user nova-compute[74048]:   <name>instance-00000031</name>
Oct 25 17:01:51 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 17:01:51 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 17:01:51 user nova-compute[74048]:   <metadata>
Oct 25 17:01:51 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:01:51 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 17:01:51 user nova-compute[74048]:       <nova:name>tempest-VolumesActionsTest-instance-168228602</nova:name>
Oct 25 17:01:51 user nova-compute[74048]:       <nova:creationTime>2023-10-25 17:01:51</nova:creationTime>
Oct 25 17:01:51 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 17:01:51 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:01:51 user nova-compute[74048]:       </nova:flavor>
Oct 25 17:01:51 user nova-compute[74048]:       <nova:owner>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:user uuid="4107b1ecad164078a7ffa1060fe2b886">tempest-VolumesActionsTest-475030454-project-member</nova:user>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:project uuid="c297e8975e7a455d9d3f5c9b510d145a">tempest-VolumesActionsTest-475030454</nova:project>
Oct 25 17:01:51 user nova-compute[74048]:       </nova:owner>
Oct 25 17:01:51 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 17:01:51 user nova-compute[74048]:       <nova:ports>
Oct 25 17:01:51 user nova-compute[74048]:         <nova:port uuid="bf5df02e-9c2e-4500-ab79-c4dde3f9c64a">
Oct 25 17:01:51 user nova-compute[74048]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 17:01:51 user nova-compute[74048]:         </nova:port>
Oct 25 17:01:51 user nova-compute[74048]:       </nova:ports>
Oct 25 17:01:51 user nova-compute[74048]:     </nova:instance>
Oct 25 17:01:51 user nova-compute[74048]:   </metadata>
Oct 25 17:01:51 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 17:01:51 user nova-compute[74048]:     <system>
Oct 25 17:01:51 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:01:51 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:01:51 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 17:01:51 user nova-compute[74048]:       <entry name="serial">429db749-f049-4e92-9582-9c05003f7f0b</entry>
Oct 25 17:01:51 user nova-compute[74048]:       <entry name="uuid">429db749-f049-4e92-9582-9c05003f7f0b</entry>
Oct 25 17:01:51 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:01:51 user nova-compute[74048]:     </system>
Oct 25 17:01:51 user nova-compute[74048]:   </sysinfo>
Oct 25 17:01:51 user nova-compute[74048]:   <os>
Oct 25 17:01:51 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:01:51 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 17:01:51 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 17:01:51 user nova-compute[74048]:   </os>
Oct 25 17:01:51 user nova-compute[74048]:   <features>
Oct 25 17:01:51 user nova-compute[74048]:     <acpi/>
Oct 25 17:01:51 user nova-compute[74048]:     <apic/>
Oct 25 17:01:51 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 17:01:51 user nova-compute[74048]:   </features>
Oct 25 17:01:51 user nova-compute[74048]:   <clock offset="utc">
Oct 25 17:01:51 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:01:51 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:01:51 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 17:01:51 user nova-compute[74048]:   </clock>
Oct 25 17:01:51 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 17:01:51 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 17:01:51 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:01:51 user nova-compute[74048]:   </cpu>
Oct 25 17:01:51 user nova-compute[74048]:   <devices>
Oct 25 17:01:51 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 17:01:51 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:01:51 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk"/>
Oct 25 17:01:51 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 17:01:51 user nova-compute[74048]:     </disk>
Oct 25 17:01:51 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 17:01:51 user nova-compute[74048]:       <mac address="fa:16:3e:c0:34:a6"/>
Oct 25 17:01:51 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 17:01:51 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 17:01:51 user nova-compute[74048]:       <target dev="tapbf5df02e-9c"/>
Oct 25 17:01:51 user nova-compute[74048]:     </interface>
Oct 25 17:01:51 user nova-compute[74048]:     <serial type="pty">
Oct 25 17:01:51 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/console.log" append="off"/>
Oct 25 17:01:51 user nova-compute[74048]:     </serial>
Oct 25 17:01:51 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:01:51 user nova-compute[74048]:     <video>
Oct 25 17:01:51 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 17:01:51 user nova-compute[74048]:     </video>
Oct 25 17:01:51 user nova-compute[74048]:     <rng model="virtio">
Oct 25 17:01:51 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:01:51 user nova-compute[74048]:     </rng>
Oct 25 17:01:51 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:01:51 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 17:01:51 user nova-compute[74048]:       <stats period="10"/>
Oct 25 17:01:51 user nova-compute[74048]:     </memballoon>
Oct 25 17:01:51 user nova-compute[74048]:   </devices>
Oct 25 17:01:51 user nova-compute[74048]: </domain>
Oct 25 17:01:51 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-168228602',display_name='tempest-VolumesActionsTest-instance-168228602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-168228602',id=49,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c297e8975e7a455d9d3f5c9b510d145a',ramdisk_id='',reservation_id='r-u3x23zdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-475030454',owner_user_name='tempest-VolumesActionsTest-475030454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:01:50Z,user_data=None,user_id='4107b1ecad164078a7ffa1060fe2b886',uuid=429db749-f049-4e92-9582-9c05003f7f0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Converting VIF {"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG os_vif [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18db68d8-dbb7-52e8-9998-60f6d4ecb922', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5df02e-9c, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf5df02e-9c, col_values=(('qos', UUID('822c3234-f44e-4ed8-b82e-8aca53bc5d1c')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf5df02e-9c, col_values=(('external_ids', {'iface-id': 'bf5df02e-9c2e-4500-ab79-c4dde3f9c64a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:34:a6', 'vm-uuid': '429db749-f049-4e92-9582-9c05003f7f0b'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:51 user nova-compute[74048]: INFO os_vif [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c')
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:01:51 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] No VIF found with MAC fa:16:3e:c0:34:a6, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:01:52 user nova-compute[74048]: DEBUG nova.network.neutron [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Updated VIF entry in instance network info cache for port bf5df02e-9c2e-4500-ab79-c4dde3f9c64a. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:01:52 user nova-compute[74048]: DEBUG nova.network.neutron [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Updating instance_info_cache with network_info: [{"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:01:52 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-544a86ec-89b2-461c-837a-5b2b98e6f861 req-65ec1a5d-2784-4563-bc9f-9dcb67f0d96e service nova] Releasing lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-18cc7aee-7638-47a0-adb3-f78eda696cb7 req-96947465-66b9-48e8-bdbe-c56963e45d37 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-18cc7aee-7638-47a0-adb3-f78eda696cb7 req-96947465-66b9-48e8-bdbe-c56963e45d37 service nova] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-18cc7aee-7638-47a0-adb3-f78eda696cb7 req-96947465-66b9-48e8-bdbe-c56963e45d37 service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-18cc7aee-7638-47a0-adb3-f78eda696cb7 req-96947465-66b9-48e8-bdbe-c56963e45d37 service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG nova.compute.manager [req-18cc7aee-7638-47a0-adb3-f78eda696cb7 req-96947465-66b9-48e8-bdbe-c56963e45d37 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] No waiting events found dispatching network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:01:53 user nova-compute[74048]: WARNING nova.compute.manager [req-18cc7aee-7638-47a0-adb3-f78eda696cb7 req-96947465-66b9-48e8-bdbe-c56963e45d37 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received unexpected event network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a for instance with vm_state building and task_state spawning.
Oct 25 17:01:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:01:55 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Instance spawned successfully.
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:01:55 user nova-compute[74048]: INFO nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Took 5.00 seconds to spawn the instance on the hypervisor.
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:01:55 user nova-compute[74048]: INFO nova.compute.manager [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Took 5.76 seconds to build instance.
Oct 25 17:01:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-f73ee236-cc1d-4cbe-81d9-4c616ea2bc20 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "429db749-f049-4e92-9582-9c05003f7f0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.860s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-e0936a00-17e1-486f-a345-9d16235ce182 req-44755334-7e4d-478c-9488-766e9542abab service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e0936a00-17e1-486f-a345-9d16235ce182 req-44755334-7e4d-478c-9488-766e9542abab service nova] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e0936a00-17e1-486f-a345-9d16235ce182 req-44755334-7e4d-478c-9488-766e9542abab service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-e0936a00-17e1-486f-a345-9d16235ce182 req-44755334-7e4d-478c-9488-766e9542abab service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:01:55 user nova-compute[74048]: DEBUG nova.compute.manager [req-e0936a00-17e1-486f-a345-9d16235ce182 req-44755334-7e4d-478c-9488-766e9542abab service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] No waiting events found dispatching network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:01:55 user nova-compute[74048]: WARNING nova.compute.manager [req-e0936a00-17e1-486f-a345-9d16235ce182 req-44755334-7e4d-478c-9488-766e9542abab service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received unexpected event network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a for instance with vm_state active and task_state None.
Oct 25 17:01:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:01:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.434s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:04 user nova-compute[74048]: INFO nova.compute.manager [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Terminating instance
Oct 25 17:02:04 user nova-compute[74048]: DEBUG nova.compute.manager [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:04 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-de37507f-513c-4e5f-b40f-5d4d446e20be req-6e303c89-d194-4bfb-abeb-44e31ed3615d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-vif-unplugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-de37507f-513c-4e5f-b40f-5d4d446e20be req-6e303c89-d194-4bfb-abeb-44e31ed3615d service nova] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-de37507f-513c-4e5f-b40f-5d4d446e20be req-6e303c89-d194-4bfb-abeb-44e31ed3615d service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-de37507f-513c-4e5f-b40f-5d4d446e20be req-6e303c89-d194-4bfb-abeb-44e31ed3615d service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-de37507f-513c-4e5f-b40f-5d4d446e20be req-6e303c89-d194-4bfb-abeb-44e31ed3615d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] No waiting events found dispatching network-vif-unplugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.manager [req-de37507f-513c-4e5f-b40f-5d4d446e20be req-6e303c89-d194-4bfb-abeb-44e31ed3615d service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-vif-unplugged-d511c524-6a09-41bf-ab73-4dc476971275 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:02:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Instance destroyed successfully.
Oct 25 17:02:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:02:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=25.112319946289062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.objects.instance [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lazy-loading 'resources' on Instance uuid 84006653-191e-4f73-b505-741e2abb95ab {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1193461110',display_name='tempest-SnapshotDataIntegrityTests-server-1193461110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1193461110',id=45,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSw5dkBxJZzQlCcHuiJhKwGKukrdY9rTG4S/pLoF77q8QaCHFomFGVpvd6fHltOoP8wqCqvTy4928lv3L1zaNa6910q1sul4KaNLlk3EVykU49ftAjGtdpjFo9CTeNgdg==',key_name='tempest-keypair-1893477291',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:53:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5779faa4ac7c43eeab1e725056249db5',ramdisk_id='',reservation_id='r-m1wbyio5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-283064237',owner_user_name='tempest-SnapshotDataIntegrityTests-283064237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d15a2b8965674044bc470c92ab59febb',uuid=84006653-191e-4f73-b505-741e2abb95ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Converting VIF {"id": "d511c524-6a09-41bf-ab73-4dc476971275", "address": "fa:16:3e:a7:b2:ce", "network": {"id": "f14c5364-962a-4aae-824c-c7275ed42b1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1247904757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5779faa4ac7c43eeab1e725056249db5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd511c524-6a", "ovs_interfaceid": "d511c524-6a09-41bf-ab73-4dc476971275", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG os_vif [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd511c524-6a, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=548d3481-fa56-404a-9224-1f17fbbd9111) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:02:05 user nova-compute[74048]: INFO os_vif [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:b2:ce,bridge_name='br-int',has_traffic_filtering=True,id=d511c524-6a09-41bf-ab73-4dc476971275,network=Network(f14c5364-962a-4aae-824c-c7275ed42b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd511c524-6a')
Oct 25 17:02:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Deleting instance files /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab_del
Oct 25 17:02:05 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Deletion of /opt/stack/data/nova/instances/84006653-191e-4f73-b505-741e2abb95ab_del complete
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 84006653-191e-4f73-b505-741e2abb95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 429db749-f049-4e92-9582-9c05003f7f0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:02:05 user nova-compute[74048]: INFO nova.compute.manager [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 84006653-191e-4f73-b505-741e2abb95ab] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:02:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:02:06 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Took 0.92 seconds to deallocate network for instance.
Oct 25 17:02:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] Acquiring lock "84006653-191e-4f73-b505-741e2abb95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] Lock "84006653-191e-4f73-b505-741e2abb95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] No waiting events found dispatching network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:02:06 user nova-compute[74048]: WARNING nova.compute.manager [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received unexpected event network-vif-plugged-d511c524-6a09-41bf-ab73-4dc476971275 for instance with vm_state deleted and task_state None.
Oct 25 17:02:06 user nova-compute[74048]: DEBUG nova.compute.manager [req-7bcec82f-3c76-494b-a0a5-3c13c88b1c23 req-aacbf06a-9bc5-4520-a9b3-566b56fb7bff service nova] [instance: 84006653-191e-4f73-b505-741e2abb95ab] Received event network-vif-deleted-d511c524-6a09-41bf-ab73-4dc476971275 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:02:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:06 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Deleted allocations for instance 84006653-191e-4f73-b505-741e2abb95ab
Oct 25 17:02:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-6ab351d1-30f0-40b1-98f2-fe1af85aa9ae tempest-SnapshotDataIntegrityTests-283064237 tempest-SnapshotDataIntegrityTests-283064237-project-member] Lock "84006653-191e-4f73-b505-741e2abb95ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:02:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:09 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa is timed out.
Oct 25 17:02:09 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully detached device vdb from instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa from the live domain config.
Oct 25 17:02:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCBUrKJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:02:09 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d0e122-5f6d-44c7-8869-8cfca20ae048]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:02:09 user nova-compute[74048]: No targets found.
Oct 25 17:02:09 user nova-compute[74048]: iSNS:
Oct 25 17:02:09 user nova-compute[74048]: No targets found.
Oct 25 17:02:09 user nova-compute[74048]: STATIC:
Oct 25 17:02:09 user nova-compute[74048]: Target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86
Oct 25 17:02:09 user nova-compute[74048]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:02:09 user nova-compute[74048]:                 Iface Name: default
Oct 25 17:02:09 user nova-compute[74048]: FIRMWARE:
Oct 25 17:02:09 user nova-compute[74048]: No targets found.
Oct 25 17:02:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:02:09 user nova-compute[74048]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:02:09 user nova-compute[74048]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74048) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86', 0)] {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a83ed0-b3d9-4ed1-90aa-2f244a8cc0c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be493aa-73c4-4305-8231-6f46b26dea61]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)
Oct 25 17:02:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 (non-flash)
Oct 25 17:02:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18405c3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86'): ({'sdb'}, set())}) {{(pid=74048) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Removing single pathed devices sdb {{(pid=74048) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a545a20-f352-4bad-a8a9-76a58aeca486]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f755452-0673-4511-af52-77420f2d84da]: (4, ('ok\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Flushing IO for device /dev/sdb {{(pid=74048) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3ed15-5f5c-482e-955c-42c879644dc6]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74048) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e1268-f85b-4309-94a3-62fb269e92bb]: (4, ('1', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.linuxscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] SCSI volumes sdb have been removed. {{(pid=74048) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86')] {{(pid=74048) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeeda60-5cdb-45f3-a8d0-66cefc8bbda1]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --logout {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf1358e-391f-4800-8a20-6d7cd38da0d8]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260]
Oct 25 17:02:09 user nova-compute[74048]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86, portal: 172.16.0.220,3260] successful.
Oct 25 17:02:09 user nova-compute[74048]:  stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op delete {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a04bb-da1e-4b61-b34a-2eede7e65be4]: (4, ('', '')) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74048) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== disconnect_volume: return (295ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:02:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG nova.objects.instance [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'flavor' on Instance uuid fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-b71220fe-1255-4b8b-b4ac-aec64fd30718 tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.770s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:10 user nova-compute[74048]: INFO nova.compute.manager [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Terminating instance
Oct 25 17:02:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Skipping network cache update for instance because it is being deleted. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 25 17:02:10 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-04543be2-0ed0-4a32-b093-3ff4a62ce5ea req-a9cf5828-992d-43f1-a0c1-faf53dd5373a service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-vif-unplugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-04543be2-0ed0-4a32-b093-3ff4a62ce5ea req-a9cf5828-992d-43f1-a0c1-faf53dd5373a service nova] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-04543be2-0ed0-4a32-b093-3ff4a62ce5ea req-a9cf5828-992d-43f1-a0c1-faf53dd5373a service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-04543be2-0ed0-4a32-b093-3ff4a62ce5ea req-a9cf5828-992d-43f1-a0c1-faf53dd5373a service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-04543be2-0ed0-4a32-b093-3ff4a62ce5ea req-a9cf5828-992d-43f1-a0c1-faf53dd5373a service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] No waiting events found dispatching network-vif-unplugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.compute.manager [req-04543be2-0ed0-4a32-b093-3ff4a62ce5ea req-a9cf5828-992d-43f1-a0c1-faf53dd5373a service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-vif-unplugged-0f38eb26-1b9c-492c-8950-f36127a4884b for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Instance destroyed successfully.
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.objects.instance [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lazy-loading 'resources' on Instance uuid fe272fb2-0e4f-4e1a-a54e-af881343f2fa {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T16:58:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1872462684',display_name='tempest-VolumesSnapshotTestJSON-instance-1872462684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1872462684',id=48,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ1hPagfVUrBGgk0FN2RJ+vV83tu176uX0lAKyAyqa0CTv20zfOD01cRCIWK4u5FtNIcrIh3zFFYfdYrADkv4NlUEfoihNPla0PAG8m4arMzBTJpHBiranpi53xHHxMfg==',key_name='tempest-keypair-1229417259',keypairs=<?>,launch_index=0,launched_at=2023-10-25T16:58:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a28c6406a21048bd88b6defdb0547fba',ramdisk_id='',reservation_id='r-feb0jrvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1876187338',owner_user_name='tempest-VolumesSnapshotTestJSON-1876187338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T16:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78ebbfe155248d28d49a46798eb5870',uuid=fe272fb2-0e4f-4e1a-a54e-af881343f2fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converting VIF {"id": "0f38eb26-1b9c-492c-8950-f36127a4884b", "address": "fa:16:3e:50:49:30", "network": {"id": "60015a19-81d5-44c4-9e9e-63ec0824719b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-799071409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a28c6406a21048bd88b6defdb0547fba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f38eb26-1b", "ovs_interfaceid": "0f38eb26-1b9c-492c-8950-f36127a4884b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_vif [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f38eb26-1b, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b596405-4521-492c-bc46-76e494446e50) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:02:11 user nova-compute[74048]: INFO os_vif [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:49:30,bridge_name='br-int',has_traffic_filtering=True,id=0f38eb26-1b9c-492c-8950-f36127a4884b,network=Network(60015a19-81d5-44c4-9e9e-63ec0824719b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f38eb26-1b')
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] calling os-brick to detach iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f185811dab0>, {'target_iqn': 'iqn.2010-10.org.openstack:09242edf-15da-4285-9f3c-12767da15a86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCBUrKJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:02:11 user nova-compute[74048]: WARNING os_brick.initiator.connectors.base [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85401) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[1730131d-dd97-4ba5-8087-0428d87de8ab]: Unexpected error while running command.
Oct 25 17:02:11 user nova-compute[74048]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 17:02:11 user nova-compute[74048]: Exit code: 21
Oct 25 17:02:11 user nova-compute[74048]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 17:02:11 user nova-compute[74048]: Stderr: '' {{(pid=85401) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 25 17:02:11 user nova-compute[74048]: Traceback (most recent call last):
Oct 25 17:02:11 user nova-compute[74048]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 25 17:02:11 user nova-compute[74048]:     ret = func(*f_args, **f_kwargs)
Oct 25 17:02:11 user nova-compute[74048]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 25 17:02:11 user nova-compute[74048]:     return func(*args, **kwargs)
Oct 25 17:02:11 user nova-compute[74048]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 25 17:02:11 user nova-compute[74048]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 25 17:02:11 user nova-compute[74048]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 25 17:02:11 user nova-compute[74048]:     return putils.execute(on_execute=on_execute,
Oct 25 17:02:11 user nova-compute[74048]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 25 17:02:11 user nova-compute[74048]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 25 17:02:11 user nova-compute[74048]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 17:02:11 user nova-compute[74048]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 17:02:11 user nova-compute[74048]: Exit code: 21
Oct 25 17:02:11 user nova-compute[74048]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 17:02:11 user nova-compute[74048]: Stderr: ''
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730131d-dd97-4ba5-8087-0428d87de8ab]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85401) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 17:02:11 user nova-compute[74048]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 17:02:11 user nova-compute[74048]: Exit code: 21
Oct 25 17:02:11 user nova-compute[74048]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 17:02:11 user nova-compute[74048]: Stderr: ''
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 25 17:02:11 user nova-compute[74048]: ERROR os_brick.initiator.connectors.iscsi 
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74048) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.base [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] <== disconnect_volume: return (34ms) None {{(pid=74048) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Disconnected iSCSI Volume {{(pid=74048) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:02:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Deleting instance files /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa_del
Oct 25 17:02:11 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Deletion of /opt/stack/data/nova/instances/fe272fb2-0e4f-4e1a-a54e-af881343f2fa_del complete
Oct 25 17:02:11 user nova-compute[74048]: INFO nova.compute.manager [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 17:02:11 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:02:11 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:02:12 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Took 0.71 seconds to deallocate network for instance.
Oct 25 17:02:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-77b7ceab-164d-4810-88c7-903c4d841f1d req-a303d839-3b7a-4302-96ca-d51a6ae53ba0 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-vif-deleted-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:02:12 user nova-compute[74048]: INFO nova.compute.manager [req-77b7ceab-164d-4810-88c7-903c4d841f1d req-a303d839-3b7a-4302-96ca-d51a6ae53ba0 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Neutron deleted interface 0f38eb26-1b9c-492c-8950-f36127a4884b; detaching it from the instance and deleting it from the info cache
Oct 25 17:02:12 user nova-compute[74048]: DEBUG nova.network.neutron [req-77b7ceab-164d-4810-88c7-903c4d841f1d req-a303d839-3b7a-4302-96ca-d51a6ae53ba0 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-77b7ceab-164d-4810-88c7-903c4d841f1d req-a303d839-3b7a-4302-96ca-d51a6ae53ba0 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Detach interface failed, port_id=0f38eb26-1b9c-492c-8950-f36127a4884b, reason: Instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:02:12 user nova-compute[74048]: WARNING nova.volume.cinder [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Attachment ca2575ba-7a50-44a8-a218-76f91c575c20 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ca2575ba-7a50-44a8-a218-76f91c575c20. (HTTP 404) (Request-ID: req-d5e0ccaf-5903-499a-862b-44e25044d1a5)
Oct 25 17:02:12 user nova-compute[74048]: INFO nova.compute.manager [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Took 0.03 seconds to detach 1 volumes for instance.
Oct 25 17:02:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:12 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Deleted allocations for instance fe272fb2-0e4f-4e1a-a54e-af881343f2fa
Oct 25 17:02:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-2ebc0b96-7c67-4e6f-a63b-e94f6d455c1f tempest-VolumesSnapshotTestJSON-1876187338 tempest-VolumesSnapshotTestJSON-1876187338-project-member] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-8f0c3ec8-fdd1-43b3-854e-f53d1b59f308 req-29e7e43c-4bd8-476c-b621-493e46d53e79 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received event network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:02:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8f0c3ec8-fdd1-43b3-854e-f53d1b59f308 req-29e7e43c-4bd8-476c-b621-493e46d53e79 service nova] Acquiring lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:02:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8f0c3ec8-fdd1-43b3-854e-f53d1b59f308 req-29e7e43c-4bd8-476c-b621-493e46d53e79 service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:02:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-8f0c3ec8-fdd1-43b3-854e-f53d1b59f308 req-29e7e43c-4bd8-476c-b621-493e46d53e79 service nova] Lock "fe272fb2-0e4f-4e1a-a54e-af881343f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:02:13 user nova-compute[74048]: DEBUG nova.compute.manager [req-8f0c3ec8-fdd1-43b3-854e-f53d1b59f308 req-29e7e43c-4bd8-476c-b621-493e46d53e79 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] No waiting events found dispatching network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:02:13 user nova-compute[74048]: WARNING nova.compute.manager [req-8f0c3ec8-fdd1-43b3-854e-f53d1b59f308 req-29e7e43c-4bd8-476c-b621-493e46d53e79 service nova] [instance: fe272fb2-0e4f-4e1a-a54e-af881343f2fa] Received unexpected event network-vif-plugged-0f38eb26-1b9c-492c-8950-f36127a4884b for instance with vm_state deleted and task_state None.
Oct 25 17:02:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:02:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:02:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:02:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:02:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:03:03 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:03:03 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=25.137271881103516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 429db749-f049-4e92-9582-9c05003f7f0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:03:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:03:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:03:12 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid 429db749-f049-4e92-9582-9c05003f7f0b {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:03:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Updating instance_info_cache with network_info: [{"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:03:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-429db749-f049-4e92-9582-9c05003f7f0b" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:03:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:03:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:16 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:03:21 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:31 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:03:36 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:03:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:03:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:03:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:03:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "429db749-f049-4e92-9582-9c05003f7f0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:57 user nova-compute[74048]: INFO nova.compute.manager [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Terminating instance
Oct 25 17:03:57 user nova-compute[74048]: DEBUG nova.compute.manager [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4daec24-f86a-40c1-81fb-eb4744550e88 req-34afe688-8ec2-42cf-b5e9-1269957e9c6b service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-vif-unplugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4daec24-f86a-40c1-81fb-eb4744550e88 req-34afe688-8ec2-42cf-b5e9-1269957e9c6b service nova] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4daec24-f86a-40c1-81fb-eb4744550e88 req-34afe688-8ec2-42cf-b5e9-1269957e9c6b service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-f4daec24-f86a-40c1-81fb-eb4744550e88 req-34afe688-8ec2-42cf-b5e9-1269957e9c6b service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4daec24-f86a-40c1-81fb-eb4744550e88 req-34afe688-8ec2-42cf-b5e9-1269957e9c6b service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] No waiting events found dispatching network-vif-unplugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG nova.compute.manager [req-f4daec24-f86a-40c1-81fb-eb4744550e88 req-34afe688-8ec2-42cf-b5e9-1269957e9c6b service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-vif-unplugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:03:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Instance destroyed successfully.
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.objects.instance [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lazy-loading 'resources' on Instance uuid 429db749-f049-4e92-9582-9c05003f7f0b {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-168228602',display_name='tempest-VolumesActionsTest-instance-168228602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-168228602',id=49,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c297e8975e7a455d9d3f5c9b510d145a',ramdisk_id='',reservation_id='r-u3x23zdw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-475030454',owner_user_name='tempest-VolumesActionsTest-475030454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:01:55Z,user_data=None,user_id='4107b1ecad164078a7ffa1060fe2b886',uuid=429db749-f049-4e92-9582-9c05003f7f0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Converting VIF {"id": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "address": "fa:16:3e:c0:34:a6", "network": {"id": "4d94f1d7-87c5-455c-83ed-d3bdb20b90a5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1269493664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c297e8975e7a455d9d3f5c9b510d145a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5df02e-9c", "ovs_interfaceid": "bf5df02e-9c2e-4500-ab79-c4dde3f9c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG os_vif [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5df02e-9c, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=822c3234-f44e-4ed8-b82e-8aca53bc5d1c) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:03:58 user nova-compute[74048]: INFO os_vif [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:34:a6,bridge_name='br-int',has_traffic_filtering=True,id=bf5df02e-9c2e-4500-ab79-c4dde3f9c64a,network=Network(4d94f1d7-87c5-455c-83ed-d3bdb20b90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5df02e-9c')
Oct 25 17:03:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Deleting instance files /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b_del
Oct 25 17:03:58 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Deletion of /opt/stack/data/nova/instances/429db749-f049-4e92-9582-9c05003f7f0b_del complete
Oct 25 17:03:58 user nova-compute[74048]: INFO nova.compute.manager [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 17:03:58 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:03:58 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Took 0.46 seconds to deallocate network for instance.
Oct 25 17:03:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG nova.compute.manager [req-9e9cf65b-1267-4d88-bd29-5fd5f3982a15 req-2a19bdb4-7477-4940-a1fd-620effea03f7 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-vif-deleted-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:03:58 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:58 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Deleted allocations for instance 429db749-f049-4e92-9582-9c05003f7f0b
Oct 25 17:03:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-70cf751f-025c-42bf-8384-d49f3dd7c467 tempest-VolumesActionsTest-475030454 tempest-VolumesActionsTest-475030454-project-member] Lock "429db749-f049-4e92-9582-9c05003f7f0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-bb5bc2eb-9e89-46f6-99ad-1a043c7740d4 req-5f915d15-e9ad-4640-9aa7-6f67f36e2596 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received event network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:03:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bb5bc2eb-9e89-46f6-99ad-1a043c7740d4 req-5f915d15-e9ad-4640-9aa7-6f67f36e2596 service nova] Acquiring lock "429db749-f049-4e92-9582-9c05003f7f0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:03:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bb5bc2eb-9e89-46f6-99ad-1a043c7740d4 req-5f915d15-e9ad-4640-9aa7-6f67f36e2596 service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:03:59 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-bb5bc2eb-9e89-46f6-99ad-1a043c7740d4 req-5f915d15-e9ad-4640-9aa7-6f67f36e2596 service nova] Lock "429db749-f049-4e92-9582-9c05003f7f0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:03:59 user nova-compute[74048]: DEBUG nova.compute.manager [req-bb5bc2eb-9e89-46f6-99ad-1a043c7740d4 req-5f915d15-e9ad-4640-9aa7-6f67f36e2596 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] No waiting events found dispatching network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:03:59 user nova-compute[74048]: WARNING nova.compute.manager [req-bb5bc2eb-9e89-46f6-99ad-1a043c7740d4 req-5f915d15-e9ad-4640-9aa7-6f67f36e2596 service nova] [instance: 429db749-f049-4e92-9582-9c05003f7f0b] Received unexpected event network-vif-plugged-bf5df02e-9c2e-4500-ab79-c4dde3f9c64a for instance with vm_state deleted and task_state None.
Oct 25 17:04:02 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:04:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:04:02 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:04:02 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:03 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:04:03 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:04:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.163127899169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:04:03 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:04:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:05 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:04:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:04:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:04:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:04:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:17 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:04:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:04:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:04:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:04:28 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:33 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:34 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:38 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:04:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:04:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:04:43 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:48 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:04:53 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:04:58 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:05:03 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:05:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:04 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:05:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:05:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:05:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9115MB free_disk=25.15316390991211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:05:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:06 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:05:08 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:10 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:05:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:05:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:05:13 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:05:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:16 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:18 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Starting instance... {{(pid=74048) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74048) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:05:19 user nova-compute[74048]: INFO nova.compute.claims [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Claim successful on node user
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Start building networks asynchronously for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Allocating IP information in the background. {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] allocate_for_instance() {{(pid=74048) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:05:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Start building block device mappings for instance. {{(pid=74048) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Start spawning the instance on the hypervisor. {{(pid=74048) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Creating instance directory {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:05:19 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Creating image(s)
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "/opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "/opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "/opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG nova.policy [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '215217e4c9a34390a49962bdd30ebabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3445f167bbea4b79b947534253029c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74048) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:19 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk 1073741824 {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7,backing_fmt=raw /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk 1073741824" returned: 0 in 0.059s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "db06fb9e8702e3658cbbec1a20cc6311f75ff5b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db06fb9e8702e3658cbbec1a20cc6311f75ff5b7 --force-share --output=json" returned: 0 in 0.273s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk. size=1073741824 {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG nova.virt.disk.api [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Cannot resize image /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk to a smaller size. {{(pid=74048) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Created local disks {{(pid=74048) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Ensure instance console log exists: /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/console.log {{(pid=74048) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:20 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Successfully created port: cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Successfully updated port: cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquired lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Building network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-changed-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG nova.compute.manager [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Refreshing instance network info cache due to event network-changed-cd7ef64e-a693-4cab-b034-cad35ac95773. {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:05:21 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] Acquiring lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Instance cache missing network info. {{(pid=74048) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.neutron [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updating instance_info_cache with network_info: [{"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Releasing lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Instance network_info: |[{"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74048) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] Acquired lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.neutron [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Refreshing network info cache for port cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Start _get_guest_xml network_info=[{"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'guest_format': None, 'encrypted': False, 'image_id': '67778d28-28b7-4dc4-a7ab-187332587d81'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:05:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:05:22 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CPU controller missing on host. {{(pid=74048) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.host [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CPU controller found on host. {{(pid=74048) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74048) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T16:20:45Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T16:20:56Z,direct_url=<?>,disk_format='qcow2',id=67778d28-28b7-4dc4-a7ab-187332587d81,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f59c7dda32664cb6891788b0777b9dd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T16:20:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Flavor limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Image limits 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Flavor pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Image pref 0:0:0 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74048) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Got 1 possible topologies {{(pid=74048) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.hardware [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74048) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-604454785',display_name='tempest-VolumesNegativeTest-instance-604454785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-604454785',id=50,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3445f167bbea4b79b947534253029c4a',ramdisk_id='',reservation_id='r-hzcpva35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-596425211',owner_user_name='tempest-VolumesNegativeTest-596425211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:05:20Z,user_data=None,user_id='215217e4c9a34390a49962bdd30ebabc',uuid=3608947a-5713-4fa7-a138-8c4b50b19e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74048) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Converting VIF {"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lazy-loading 'pci_devices' on Instance uuid 3608947a-5713-4fa7-a138-8c4b50b19e10 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:05:22 user nova-compute[74048]:   <uuid>3608947a-5713-4fa7-a138-8c4b50b19e10</uuid>
Oct 25 17:05:22 user nova-compute[74048]:   <name>instance-00000032</name>
Oct 25 17:05:22 user nova-compute[74048]:   <memory>524288</memory>
Oct 25 17:05:22 user nova-compute[74048]:   <vcpu>1</vcpu>
Oct 25 17:05:22 user nova-compute[74048]:   <metadata>
Oct 25 17:05:22 user nova-compute[74048]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:05:22 user nova-compute[74048]:       <nova:package version="0.0.0"/>
Oct 25 17:05:22 user nova-compute[74048]:       <nova:name>tempest-VolumesNegativeTest-instance-604454785</nova:name>
Oct 25 17:05:22 user nova-compute[74048]:       <nova:creationTime>2023-10-25 17:05:22</nova:creationTime>
Oct 25 17:05:22 user nova-compute[74048]:       <nova:flavor name="m1.tiny">
Oct 25 17:05:22 user nova-compute[74048]:         <nova:memory>512</nova:memory>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:disk>1</nova:disk>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:swap>0</nova:swap>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:05:22 user nova-compute[74048]:       </nova:flavor>
Oct 25 17:05:22 user nova-compute[74048]:       <nova:owner>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:user uuid="215217e4c9a34390a49962bdd30ebabc">tempest-VolumesNegativeTest-596425211-project-member</nova:user>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:project uuid="3445f167bbea4b79b947534253029c4a">tempest-VolumesNegativeTest-596425211</nova:project>
Oct 25 17:05:22 user nova-compute[74048]:       </nova:owner>
Oct 25 17:05:22 user nova-compute[74048]:       <nova:root type="image" uuid="67778d28-28b7-4dc4-a7ab-187332587d81"/>
Oct 25 17:05:22 user nova-compute[74048]:       <nova:ports>
Oct 25 17:05:22 user nova-compute[74048]:         <nova:port uuid="cd7ef64e-a693-4cab-b034-cad35ac95773">
Oct 25 17:05:22 user nova-compute[74048]:           <nova:ip type="fixed" address="192.168.233.50" ipVersion="4"/>
Oct 25 17:05:22 user nova-compute[74048]:         </nova:port>
Oct 25 17:05:22 user nova-compute[74048]:       </nova:ports>
Oct 25 17:05:22 user nova-compute[74048]:     </nova:instance>
Oct 25 17:05:22 user nova-compute[74048]:   </metadata>
Oct 25 17:05:22 user nova-compute[74048]:   <sysinfo type="smbios">
Oct 25 17:05:22 user nova-compute[74048]:     <system>
Oct 25 17:05:22 user nova-compute[74048]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:05:22 user nova-compute[74048]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:05:22 user nova-compute[74048]:       <entry name="version">0.0.0</entry>
Oct 25 17:05:22 user nova-compute[74048]:       <entry name="serial">3608947a-5713-4fa7-a138-8c4b50b19e10</entry>
Oct 25 17:05:22 user nova-compute[74048]:       <entry name="uuid">3608947a-5713-4fa7-a138-8c4b50b19e10</entry>
Oct 25 17:05:22 user nova-compute[74048]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:05:22 user nova-compute[74048]:     </system>
Oct 25 17:05:22 user nova-compute[74048]:   </sysinfo>
Oct 25 17:05:22 user nova-compute[74048]:   <os>
Oct 25 17:05:22 user nova-compute[74048]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:05:22 user nova-compute[74048]:     <boot dev="hd"/>
Oct 25 17:05:22 user nova-compute[74048]:     <smbios mode="sysinfo"/>
Oct 25 17:05:22 user nova-compute[74048]:   </os>
Oct 25 17:05:22 user nova-compute[74048]:   <features>
Oct 25 17:05:22 user nova-compute[74048]:     <acpi/>
Oct 25 17:05:22 user nova-compute[74048]:     <apic/>
Oct 25 17:05:22 user nova-compute[74048]:     <vmcoreinfo/>
Oct 25 17:05:22 user nova-compute[74048]:   </features>
Oct 25 17:05:22 user nova-compute[74048]:   <clock offset="utc">
Oct 25 17:05:22 user nova-compute[74048]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:05:22 user nova-compute[74048]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:05:22 user nova-compute[74048]:     <timer name="hpet" present="no"/>
Oct 25 17:05:22 user nova-compute[74048]:   </clock>
Oct 25 17:05:22 user nova-compute[74048]:   <cpu mode="custom" match="exact">
Oct 25 17:05:22 user nova-compute[74048]:     <model>Nehalem</model>
Oct 25 17:05:22 user nova-compute[74048]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:05:22 user nova-compute[74048]:   </cpu>
Oct 25 17:05:22 user nova-compute[74048]:   <devices>
Oct 25 17:05:22 user nova-compute[74048]:     <disk type="file" device="disk">
Oct 25 17:05:22 user nova-compute[74048]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:05:22 user nova-compute[74048]:       <source file="/opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk"/>
Oct 25 17:05:22 user nova-compute[74048]:       <target dev="vda" bus="virtio"/>
Oct 25 17:05:22 user nova-compute[74048]:     </disk>
Oct 25 17:05:22 user nova-compute[74048]:     <interface type="ethernet">
Oct 25 17:05:22 user nova-compute[74048]:       <mac address="fa:16:3e:c3:ea:e0"/>
Oct 25 17:05:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 17:05:22 user nova-compute[74048]:       <mtu size="1442"/>
Oct 25 17:05:22 user nova-compute[74048]:       <target dev="tapcd7ef64e-a6"/>
Oct 25 17:05:22 user nova-compute[74048]:     </interface>
Oct 25 17:05:22 user nova-compute[74048]:     <serial type="pty">
Oct 25 17:05:22 user nova-compute[74048]:       <log file="/opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/console.log" append="off"/>
Oct 25 17:05:22 user nova-compute[74048]:     </serial>
Oct 25 17:05:22 user nova-compute[74048]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:05:22 user nova-compute[74048]:     <video>
Oct 25 17:05:22 user nova-compute[74048]:       <model type="virtio"/>
Oct 25 17:05:22 user nova-compute[74048]:     </video>
Oct 25 17:05:22 user nova-compute[74048]:     <rng model="virtio">
Oct 25 17:05:22 user nova-compute[74048]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:05:22 user nova-compute[74048]:     </rng>
Oct 25 17:05:22 user nova-compute[74048]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:05:22 user nova-compute[74048]:     <memballoon model="virtio">
Oct 25 17:05:22 user nova-compute[74048]:       <stats period="10"/>
Oct 25 17:05:22 user nova-compute[74048]:     </memballoon>
Oct 25 17:05:22 user nova-compute[74048]:   </devices>
Oct 25 17:05:22 user nova-compute[74048]: </domain>
Oct 25 17:05:22 user nova-compute[74048]:  {{(pid=74048) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-604454785',display_name='tempest-VolumesNegativeTest-instance-604454785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-604454785',id=50,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3445f167bbea4b79b947534253029c4a',ramdisk_id='',reservation_id='r-hzcpva35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-596425211',owner_user_name='tempest-VolumesNegativeTest-596425211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:05:20Z,user_data=None,user_id='215217e4c9a34390a49962bdd30ebabc',uuid=3608947a-5713-4fa7-a138-8c4b50b19e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Converting VIF {"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG os_vif [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6') {{(pid=74048) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd424a9b0-8a63-580f-a5f2-a57c3d7b88f6', '_type': 'linux-noop'}}, row=False) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd7ef64e-a6, may_exist=True, interface_attrs={}) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd7ef64e-a6, col_values=(('qos', UUID('ff48b222-a733-4aa3-8774-fcf54b969756')),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd7ef64e-a6, col_values=(('external_ids', {'iface-id': 'cd7ef64e-a693-4cab-b034-cad35ac95773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:ea:e0', 'vm-uuid': '3608947a-5713-4fa7-a138-8c4b50b19e10'}),), if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:22 user nova-compute[74048]: INFO os_vif [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6')
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] No BDM found with device name vda, not building metadata. {{(pid=74048) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] No VIF found with MAC fa:16:3e:c3:ea:e0, not building metadata {{(pid=74048) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.neutron [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updated VIF entry in instance network info cache for port cd7ef64e-a693-4cab-b034-cad35ac95773. {{(pid=74048) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG nova.network.neutron [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updating instance_info_cache with network_info: [{"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:05:22 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-36fd4d97-382b-4bdd-b4f3-ea1c5a588a5b req-b3991b77-f3fa-463a-b788-639dad2596ee service nova] Releasing lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:05:23 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-b4a38415-bda3-47e0-a224-9e59da50cef0 req-73cc6a1c-7bbf-4ea1-b830-481ec4bbe405 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b4a38415-bda3-47e0-a224-9e59da50cef0 req-73cc6a1c-7bbf-4ea1-b830-481ec4bbe405 service nova] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b4a38415-bda3-47e0-a224-9e59da50cef0 req-73cc6a1c-7bbf-4ea1-b830-481ec4bbe405 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-b4a38415-bda3-47e0-a224-9e59da50cef0 req-73cc6a1c-7bbf-4ea1-b830-481ec4bbe405 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG nova.compute.manager [req-b4a38415-bda3-47e0-a224-9e59da50cef0 req-73cc6a1c-7bbf-4ea1-b830-481ec4bbe405 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] No waiting events found dispatching network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:05:24 user nova-compute[74048]: WARNING nova.compute.manager [req-b4a38415-bda3-47e0-a224-9e59da50cef0 req-73cc6a1c-7bbf-4ea1-b830-481ec4bbe405 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received unexpected event network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 for instance with vm_state building and task_state spawning.
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:24 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Instance event wait completed in 0 seconds for  {{(pid=74048) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Guest created on hypervisor {{(pid=74048) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:05:26 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Instance spawned successfully.
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Found default for hw_cdrom_bus of ide {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Found default for hw_disk_bus of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Found default for hw_input_bus of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Found default for hw_pointer_model of None {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Found default for hw_video_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.virt.libvirt.driver [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Found default for hw_vif_model of virtio {{(pid=74048) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:05:26 user nova-compute[74048]: INFO nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Took 6.54 seconds to spawn the instance on the hypervisor.
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Checking state {{(pid=74048) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:05:26 user nova-compute[74048]: INFO nova.compute.manager [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Took 7.09 seconds to build instance.
Oct 25 17:05:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d441b992-62c7-4f1b-8860-48fa12a91b56 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.189s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-3504992c-bbda-4c28-a18b-ef337ca4b25f req-9ccc3576-b1f9-4e67-bf3a-5e7a5d16a041 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3504992c-bbda-4c28-a18b-ef337ca4b25f req-9ccc3576-b1f9-4e67-bf3a-5e7a5d16a041 service nova] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3504992c-bbda-4c28-a18b-ef337ca4b25f req-9ccc3576-b1f9-4e67-bf3a-5e7a5d16a041 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-3504992c-bbda-4c28-a18b-ef337ca4b25f req-9ccc3576-b1f9-4e67-bf3a-5e7a5d16a041 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:05:26 user nova-compute[74048]: DEBUG nova.compute.manager [req-3504992c-bbda-4c28-a18b-ef337ca4b25f req-9ccc3576-b1f9-4e67-bf3a-5e7a5d16a041 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] No waiting events found dispatching network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:05:26 user nova-compute[74048]: WARNING nova.compute.manager [req-3504992c-bbda-4c28-a18b-ef337ca4b25f req-9ccc3576-b1f9-4e67-bf3a-5e7a5d16a041 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received unexpected event network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 for instance with vm_state active and task_state None.
Oct 25 17:05:26 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:41 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:46 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:51 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:56 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:05:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:01 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:04 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:06:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:06:04 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:06:04 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:06:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:06:05 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.122520446777344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 3608947a-5713-4fa7-a138-8c4b50b19e10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 17:06:05 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 17:06:06 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:06:06 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:06:06 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:06:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:06:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:06 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:07 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:06:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:08 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:08 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 17:06:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:12 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquired lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Forcefully refreshing network info cache for instance {{(pid=74048) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:06:13 user nova-compute[74048]: DEBUG nova.objects.instance [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lazy-loading 'info_cache' on Instance uuid 3608947a-5713-4fa7-a138-8c4b50b19e10 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:06:14 user nova-compute[74048]: DEBUG nova.network.neutron [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updating instance_info_cache with network_info: [{"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:06:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Releasing lock "refresh_cache-3608947a-5713-4fa7-a138-8c4b50b19e10" {{(pid=74048) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:06:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updated the network info_cache for instance {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:06:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 17:06:15 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 17:06:16 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:27 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:06:32 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:06:37 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:42 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:47 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:06:57 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:07:02 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:05 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:05 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.processutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74048) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:07:06 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:07:06 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.120391845703125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Instance 3608947a-5713-4fa7-a138-8c4b50b19e10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74048) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:07:06 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:07 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:09 user nova-compute[74048]: INFO nova.compute.manager [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Terminating instance
Oct 25 17:07:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Start destroying the instance on the hypervisor. {{(pid=74048) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:09 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [-] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Instance destroyed successfully.
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.objects.instance [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lazy-loading 'resources' on Instance uuid 3608947a-5713-4fa7-a138-8c4b50b19e10 {{(pid=74048) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.virt.libvirt.vif [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-604454785',display_name='tempest-VolumesNegativeTest-instance-604454785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-604454785',id=50,image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:05:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3445f167bbea4b79b947534253029c4a',ramdisk_id='',reservation_id='r-hzcpva35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67778d28-28b7-4dc4-a7ab-187332587d81',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-596425211',owner_user_name='tempest-VolumesNegativeTest-596425211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:05:26Z,user_data=None,user_id='215217e4c9a34390a49962bdd30ebabc',uuid=3608947a-5713-4fa7-a138-8c4b50b19e10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Converting VIF {"id": "cd7ef64e-a693-4cab-b034-cad35ac95773", "address": "fa:16:3e:c3:ea:e0", "network": {"id": "cd1ce931-4bb2-4c7a-a543-edab3ffc630e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f59c7dda32664cb6891788b0777b9dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd7ef64e-a6", "ovs_interfaceid": "cd7ef64e-a693-4cab-b034-cad35ac95773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.network.os_vif_util [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6') {{(pid=74048) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG os_vif [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6') {{(pid=74048) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd7ef64e-a6, bridge=br-int, if_exists=True) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff48b222-a733-4aa3-8774-fcf54b969756) {{(pid=74048) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:10 user nova-compute[74048]: INFO os_vif [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ea:e0,bridge_name='br-int',has_traffic_filtering=True,id=cd7ef64e-a693-4cab-b034-cad35ac95773,network=Network(cd1ce931-4bb2-4c7a-a543-edab3ffc630e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd7ef64e-a6')
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Deleting instance files /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10_del
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.virt.libvirt.driver [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Deletion of /opt/stack/data/nova/instances/3608947a-5713-4fa7-a138-8c4b50b19e10_del complete
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-26a530bd-de69-4d11-aa3b-1a6f656855b9 req-058e54e1-432d-40c7-888a-3c3f08298a42 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-vif-unplugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-26a530bd-de69-4d11-aa3b-1a6f656855b9 req-058e54e1-432d-40c7-888a-3c3f08298a42 service nova] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-26a530bd-de69-4d11-aa3b-1a6f656855b9 req-058e54e1-432d-40c7-888a-3c3f08298a42 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-26a530bd-de69-4d11-aa3b-1a6f656855b9 req-058e54e1-432d-40c7-888a-3c3f08298a42 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-26a530bd-de69-4d11-aa3b-1a6f656855b9 req-058e54e1-432d-40c7-888a-3c3f08298a42 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] No waiting events found dispatching network-vif-unplugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-26a530bd-de69-4d11-aa3b-1a6f656855b9 req-058e54e1-432d-40c7-888a-3c3f08298a42 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-vif-unplugged-cd7ef64e-a693-4cab-b034-cad35ac95773 for instance with task_state deleting. {{(pid=74048) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.compute.manager [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo.service.loopingcall [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74048) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.manager [-] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Deallocating network for instance {{(pid=74048) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] deallocate_for_instance() {{(pid=74048) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.network.neutron [-] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-116c2946-34d1-4098-9d5e-72d2b304e8c4 req-91926ff7-352f-42d4-81ef-e7450eb8c1d6 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-vif-deleted-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.compute.manager [req-116c2946-34d1-4098-9d5e-72d2b304e8c4 req-91926ff7-352f-42d4-81ef-e7450eb8c1d6 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Neutron deleted interface cd7ef64e-a693-4cab-b034-cad35ac95773; detaching it from the instance and deleting it from the info cache
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.network.neutron [req-116c2946-34d1-4098-9d5e-72d2b304e8c4 req-91926ff7-352f-42d4-81ef-e7450eb8c1d6 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Updating instance_info_cache with network_info: [] {{(pid=74048) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.compute.manager [-] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Took 0.47 seconds to deallocate network for instance.
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.manager [req-116c2946-34d1-4098-9d5e-72d2b304e8c4 req-91926ff7-352f-42d4-81ef-e7450eb8c1d6 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Detach interface failed, port_id=cd7ef64e-a693-4cab-b034-cad35ac95773, reason: Instance 3608947a-5713-4fa7-a138-8c4b50b19e10 could not be found. {{(pid=74048) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:10 user nova-compute[74048]: INFO nova.scheduler.client.report [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Deleted allocations for instance 3608947a-5713-4fa7-a138-8c4b50b19e10
Oct 25 17:07:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-d7c2513c-62b5-4da2-8d56-cb7ac91c6d16 tempest-VolumesNegativeTest-596425211 tempest-VolumesNegativeTest-596425211-project-member] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.651s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-91d62833-7b39-4373-8646-604de3ffae0f req-3579bcbe-aba8-4ca0-81c6-9a353fcf1999 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received event network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:07:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-91d62833-7b39-4373-8646-604de3ffae0f req-3579bcbe-aba8-4ca0-81c6-9a353fcf1999 service nova] Acquiring lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:07:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-91d62833-7b39-4373-8646-604de3ffae0f req-3579bcbe-aba8-4ca0-81c6-9a353fcf1999 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:07:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [req-91d62833-7b39-4373-8646-604de3ffae0f req-3579bcbe-aba8-4ca0-81c6-9a353fcf1999 service nova] Lock "3608947a-5713-4fa7-a138-8c4b50b19e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:07:12 user nova-compute[74048]: DEBUG nova.compute.manager [req-91d62833-7b39-4373-8646-604de3ffae0f req-3579bcbe-aba8-4ca0-81c6-9a353fcf1999 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] No waiting events found dispatching network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 {{(pid=74048) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:07:12 user nova-compute[74048]: WARNING nova.compute.manager [req-91d62833-7b39-4373-8646-604de3ffae0f req-3579bcbe-aba8-4ca0-81c6-9a353fcf1999 service nova] [instance: 3608947a-5713-4fa7-a138-8c4b50b19e10] Received unexpected event network-vif-plugged-cd7ef64e-a693-4cab-b034-cad35ac95773 for instance with vm_state deleted and task_state None.
Oct 25 17:07:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:07:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:07:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:07:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:17 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:19 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:19 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:07:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:07:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:05 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:08:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:08:07 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:08:07 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:08:08 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:08:08 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:08:08 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=25.146896362304688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:08:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:08:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:08:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:08:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:08:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:08:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:08:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:16 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:19 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:19 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:20 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:08:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:08:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:09:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:09:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:09:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:09:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:08 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:09:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:09:08 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:09:08 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:09:09 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:09:09 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:09:09 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9193MB free_disk=25.145458221435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:09:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:09:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:09:14 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:09:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:09:14 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:09:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:15 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:17 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:17 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:20 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:22 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:09:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:09:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:10:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:10:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:10:09 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:10:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:10:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9185MB free_disk=25.13610076904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:10:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:10:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:11 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:10:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:16 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:10:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:10:16 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:10:16 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:22 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:23 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:10:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:10:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:10:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:10:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:10:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:10:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:10:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:10:52 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:10:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:11:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74048) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:11:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:11:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74048) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:11:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:06 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:11:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:11:09 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:11:09 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:11:10 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9185MB free_disk=25.134933471679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing inventories for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating ProviderTree inventory for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Updating inventory in ProviderTree for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing aggregate associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, aggregates: None {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Refreshing trait associations for resource provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74048) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:11:10 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:11:12 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:12 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:11:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:11:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:11:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:11:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:19 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:11:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:22 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:22 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:22 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74048) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 17:11:23 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:23 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:11:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Cleaning up deleted instances {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 17:11:27 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] There are 0 instances to clean {{(pid=74048) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 17:11:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:11:34 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:36 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:11:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:11:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:11:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:11:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:12:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:12:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:07 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:12:11 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:12:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:12:11 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:12:11 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:12:12 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:12:12 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:12:12 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9151MB free_disk=25.13396453857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:12:12 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:12:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:12:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:18 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:12:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:12:18 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:12:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:20 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:20 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:22 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:24 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:25 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:12:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:12:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:50 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:12:55 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:13:00 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:13:05 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:13:09 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:10 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74048) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:13:13 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Auditing locally available compute resources for user (node: user) {{(pid=74048) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:13:14 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:13:14 user nova-compute[74048]: WARNING nova.virt.libvirt.driver [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:13:14 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Hypervisor/Node resource view: name=user free_ram=9175MB free_disk=25.132667541503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74048) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74048) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG nova.compute.provider_tree [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed in ProviderTree for provider: 8251593b-3c2f-4879-90c3-e2a310c2e6f2 {{(pid=74048) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG nova.scheduler.client.report [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Inventory has not changed for provider 8251593b-3c2f-4879-90c3-e2a310c2e6f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74048) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG nova.compute.resource_tracker [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Compute_service record updated for user:user {{(pid=74048) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:13:14 user nova-compute[74048]: DEBUG oslo_concurrency.lockutils [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=74048) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:13:15 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:13:20 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:13:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Starting heal instance info cache {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:13:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Rebuilding the list of instances to heal {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:13:21 user nova-compute[74048]: DEBUG nova.compute.manager [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Didn't find any instances for network info cache update. {{(pid=74048) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:13:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:21 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:22 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:13:22 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:23 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:25 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:13:26 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:27 user nova-compute[74048]: DEBUG oslo_service.periodic_task [None req-24e794db-c475-438f-b5f8-6cb18aa45a06 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74048) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:13:30 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:13:35 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:13:40 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:13:45 user nova-compute[74048]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74048) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}